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Preface 


This book focuses on the basics of process control, process identification, PID controllers and 
autotuning. Our objective is to enable students and engineers who are not familiar with these 
topics to understand the basic concepts of feedback control, process identification, autotuning 
and design of real feedback controllers (especially PID controllers). 

Parts One and Two are aimed at undergraduate students who have not taken any courses on 
process control. Parts Three and Four are appropriate for graduate students and control 
engineers who want to design real feedback controllers or perform research on process 
identification and autotuning. Parts One and Two introduce the basics of process control and 
dynamics, the analysis tools (Bode plot, Nyquist plot) to characterize the dynamics of the 
process, PID controllers and tuning, and advanced control strategies that have been widely used 
in industry. Also, simple simulation techniques required for practical controller designs and 
research on process identification and autotuning are also included. Part Three provides useful 
process identification methods actually used in industry. It includes several important 
identification algorithms to obtain frequency models or continuous-time/discrete-time transfer 
function models from the measured process input and output data sets. Part Four introduces 
various relay feedback methods to activate the process effectively for process identification and 
controller autotuning. 

We have tried to include as many examples as possible. In particular, the readers can use the 
numerical examples and the MATLAB R codes with slight modifications to solve actual 
problems in their processes or research. The codes (MATLAB Rm-files) and real-time virtual 
processes for the simulations and practices are available from the Wiley website at www.wiley. 
com/go/swsung. The codes will be useful to those who want to understand the actual 
implementation techniques for control, process identification and autotuning. Also, the readers 
can design their own controllers, implement them and confirm the performances in real time 
using real-time virtual processes. Also, the problem-solving ability of students can be enhanced 
by performing a controller design project on the basis of the virtual process. We welcome the 
comments of students and instructors to improve the book and the materials for lectures and 
simulations. Please visit our other website at http://pse.knu.ac.kr for comments and questions 
about this book or process systems engineering. We hope this book is useful to you. 

We wish to express special thanks to the students at KNU who provided the simulation 
results and detailed reviews: Cheol Ho Je, Chun Ho Jeon and Yu Jin Cheon. We acknowledge 
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John Wiley & Sons, especially James Murphy, Roger Bullen, Sarah Abdul Karim and Peter 
Lewis, for their effective cooperation and great care in preparing this book. We also gratefully 
acknowledge the financial support by Kyungpook National University (KNU Research Fund, 
2006 ). 

Su Whan Sung 
Jietae Lee 
In-Beum Lee 



Part One 


Basics of Process 
Dynamics 


Part One introduces the basics of process dynamics which are appropriate for an undergraduate 
course. Chapter 1 defines linear processes and discusses how to represent linear processes in a 
mathematical way. Chapter 2 introduces several simulation and numerical analysis techniques 
required to simulate/design process controllers. Chapter 3 discusses the dynamic behaviors of 
linear processes and provides several analysis tools to characterize the dynamics of the control 
system. 
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Mathematical Representations 
of Linear Processes 


1.1 Introduction to Process Control and Identification 

The basic concepts and terms of process control and identification are first introduced. 


1.1.1 Process Control 

Process control consists of manipulating variables, controlled variables and processes. The 
manipulating variables and the controlled variables usually correspond to the process inputs 
and the process outputs respectively. The objective of process control is to make the process 
outputs (controlled variables) behave in a desired way by adjusting the process inputs 
(manipulating variables). Consider the temperature control system in Figure 1.1. 

The SCR unit is to provide electrical power to the heating coil, which is proportional to the 
voltage u{t). The temperature is measured by the thermocouple sensor. The objective of 
the temperature control system in Figure 1.1 is to drive the temperature y(t) to the desired 
value by adjusting u(t). So, u(t) andy(t) are the process input (manipulating variable) and the 
process output (controlled variable) respectively. The role of the feedback controller is to 
determine u(t) appropriately on the basis of the measured y(t) to achieve the control 
objective. 

Example 1.1 

Consider the control system in Figure 1.2. It consists of two tanks, a control valve, a DP cell and 
a controller. The DP cell and the control valve are to measure the liquid level of the last tank and 
adjust the inlet flow rate respectively. The objective of the control system is to drive the liquid 
level of the last tank to a desired value. In this case, the manipulating variable is the inlet flow 
rate and the controlled variable is the level of the last tank. 
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Figure 1.2 Level control system. 


1.1.2 Process Identification 

Process identification is the obtaining of a model of which the role is to predict the behavior of 
the process output for a given process input. The models are in the form of differential equations 
or frequency data sets (which will be explained later). From the energy balance equation for the 
temperature control system in Figure 1.1, the model of the following simple differential 
equation form can be derived: 


+y{l) = ku{t)-b (1.1) 

where r, k and b are known constants determined by the heat capacity, mass, amplification 
coefficient, heat transfer coefficient, area and ambient temperature. This is a simple example of 
process identification. The behavior of y{t) can be predicted by solving the differential equation 
for a given u{t). In this book, how to obtain the model from historical data of the process input 
and the process output will be treated without considering physical principles such as material 
balance, energy balance and chemical reactions. This kind of model is called a “black-box 
model.” 
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Example 1.2 

Assume that the black-box model structure for a given process has the following form: 

T^+y{t) = ku{t) (1.2) 

And assume that y(t) = I - exp(—2 1) is obtained from an experiment when uit) = 1 is 
applied to the process. Then, it is straightforward to estimate the model parameters of r and k 
from the experiment. Replace y(t) and u(t) in (1.2) by y(t) = 1 — exp(—2 1) and u{t) = 1. Then, 
(1.2) becomes (2 t— 1) exp(—2 1) + 1 =k. So, t = 0.5 and k 1 is obtained. This is a simple 
example of parameter estimation. The determination of the model structure and the parameter 
estimation are the core parts of process identification. 


Example 1.3 

Assume that the black-box model structure for a given process has the following form: 

^m +lT m +y(t)=ku{l) ( 1 . 3 ) 

And assume that y(t) = 0.5 sin(f — tt/2) is obtained from an experiment when u(t) = sin(f) is 
applied to the process. Estimate the model parameters r and k from the experiment. 

Solution Replace y(t) and u(t) in (1.3) by y{t) = 0.5 sin(f — tt/2) and u(t) = sin(f). Then, (1.3) 
becomes 


— 0.5r 2 sin(f — tt/2) + tcos (t — tt/2) + 0.5sin(t — tt/2) = k sin(t) 

which can be rewritten as (0.5r 2 — 0.5) cos(t) + r sin(f) = k sin(t) because sin(t — tt/2) = 
—cos(t) and cos(t — tt/2) = sin(t). So, r = 1.0 and k= 1 is obtained. 


1.1.3 Steady State 

When all the derivatives of the process input and process output are zero, this is called the 
steady state. For example, the process (1.4) will be (1.5) at steady state: 


d 2 y(t) 

dt 2 


(1.4) 


d 2 y S s(Q 
' dfi ' 


+ 2 

dt 


+M$ 


+ 2u ss (t) + 2 - y ss (t) = 2u ss (t) + 2 


(1.5) 


where the subscript ‘ss’ denotes steady state. As shown in (1.5), all the derivatives go to zeroes 
at steady state. On the other hand, a cyclic steady state means that the process output and input 
are periodic signals. 
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Because all the derivatives are zero at steady state, y ss (t) = \Ju is {t). So, y ss (f) = \/2J) for 
u ss (t) = 2.0 at steady state. 


Example 1.6 

Obtain y(t) for y s (t) = 1.0 at steady state for the following process: 




(1.7) 


u(t) = 1.5(y s (f)-y(t))+0.5 d(},s(?) d? y(0) (1.8) 

Because all the derivatives in (1.7) are zero at steady state, y ss (t) = u ss (t) and w ss = 
1-5 (y s ,ss — yss) are obtained from (1.7) and (1.8). So, y ss (t)= 1.5/2.5 at steady state. 

Example 1.7 

Consider the process input u(t) and the process output y(t) in Figure 1.4. It can be seen that the 
process is in cyclic steady state after about t = 15 because u(t) andy(t) are periodic after t= 15. 


1.1.4 Deviation Variables 

The deviation variable x(t) is the difference between the original variable x(t) and a reference 
value x ret . That is, x(t) = x(t) — x re f. So, it represents how far the original variable deviates 
from the reference value. The deviation variables for the process output and process input can 
be defined like y(t) = y(t) — y ref and u(t) = u(t) — u re f respectively. Here, y ref and u ref are 
usually the process output and the process input at steady state if there is no special notice. Note, 
y ref is automatically fixed for the given w ref at steady state. For example, the process (1.4) can be 
rewritten using deviation variables by subtracting (1.5) from (1.4): 


d 2 y(t) 

d t 2 


+2 m 

d t 


+y{t) = 


dtt(t) 

dt 


+ 2 «(0 


(1.9) 


y(t) =y(t)-yss, u{t) = u{t)-u &s 


( 1 . 10 ) 


where u(t) andy(f) are deviation variables. m ss andy ss are the reference values for u(t ) and y( t) 
respectively. Here, u ss and y ss should satisfy (1.5). So, y ss is automatically fixed for the given u ss 
at steady state. 

Example 1.8 

Rewrite the following process with deviation variables when the reference value for the process 
input u(t) is chosen as 2.0. 


d 3 y(Q o d 2 y(t) 

& + dfi 


+3 M>) 

d t 


+y{t) + 1 = 2 


d u{t) 
d t 


+ 3 u(t) 


( 1 . 11 ) 
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Here, u ss = 2.0. From (1.11), it is known that y ss = 5.0 for u ss = 2.0 by applying the steady- 
state assumption. So, the deviation variables (1.14) should be 

5K3~y(0-5.O, u(t)=u(t)-2.0 (1.15) 


Example 1.9 

Rewrite the following process with deviation variables when the reference value for the process 
input u(t ) is chosen as 2.0: 


^ +3 ^ +3 d^|; w + 1 = 2 'Mt^M 

dt 3 df 2 dt ' w d t 


+ 3u(t-0.5) 


(1.16) 


First, apply the steady-state assumption to (1.16): 


+3^ +3 d MH + ,„(,) + ! E 2 d “-('- 05 > 

dt 3 df 2 dt w dt 


+ 3w ss (t —0.5) 


(1.17) 


By subtracting (1.17) from (1.16) the following process described by the deviation variables 
is obtained: 


d 3 y(Q . ,d 2 y(t) 
dt 3 dt 2 


3 dy(t) 
dt 


+y(0 = 2 


dw(t — 0.5) 
dt 


+ 3w(t —0.5) 


(1.18) 


y(t)=y(t)-yss, «(t) = «(t) - u ss ( 1 . 19 ) 

From (1.16)y ss = 5.0 is obtained for u ss = 2.0 because u ss (t ) = u ss (t — 0.5) = 2.0 at steady 
state. So, the deviation variables (1.19) should be 

y(t)=y(t)-5.0, u(t) = u(t) — 2.0 (1.20) 


1.2 Properties of Linear Processes 

Linear processes are defined and several important properties of linear processes are discussed. 


1.2.1 Linear Process 

When the dynamics of a process can be described by a linear combination of derivatives (d 7 y(t)/ 
dt J ,d J u(t)/dt J ,j=0, 1,2,...) of the process output >(t) and the process input u(t) and a constant, 
it is a linear process. If the coefficients are time invariant (constants), then it is the time-invariant 
linear process. If the coefficients are time variant, then it is the time-variant linear process. For 
example, (1.4) is a linear process. But, the following processes are nonlinear: 


odMO 

df 


-“f +*» = ■ 


dy(0 


+y(0 = 4v^W 


( 1 . 21 ) 


( 1 . 22 ) 
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Equations (1.21) and (1.22) are nonlinear because of the (du(t)/dt)u(t) and \Ju(t) terms 
respectively. 


Example 1.10 

Consider the following process: 


u(t —0.5) 


Here, it should be noted that 


u(l — 0.5) = u(t) — 


(~ 0-5)' d l u(t) 
i! 


(1.23) 


(which will be discussed later). So, (1.23) is a time-invariant linear process. That is, linear 
processes can include time delays. 


Example 1.11 

Consider the following process: 


d 2 y(0 „dy(Q 
dt 


+ y(t) = u(t- 0 . 5 ) 


( 1 . 24 ) 


»( t )= 0 . 5 j \ l - y ( T))dT + 0 . 1 d(1 J {t)) ( 1 . 25 ) 

In Example 1 . 11 , it is revealed that the time delay does not change the linearity. Also, by 
differentiating ( 1 . 24 ) and ( 1 . 25 ), the integral in ( 1 . 25 ) then disappears. So, ( 1 . 24 ) and ( 1 . 25 ) is a 
time-invariant linear process. 


Example 1.12 

Consider the process 

+,(.)=«(> — 0.5) (1.26) 

»M = 2 (yM-y(t)) (1.27) 

From (1.26) and (1.27), the following process is obtained: 

+y(4= 2 L v s(/~ 0.5) — y(t — 0.5)] (1.28) 

So, the process (1.28) of which the input and output are y s (0 and y(t) is a time-invariant 
linear process. 
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Example 1.13 

Consider the process 

^#{2 + 0.U) d ^+(l-0.05 f Ml) = (2 + 0.3 (1.29) 

in which the coefficients are time variant. Thus, this is a time-variant linear process. 

1.2.2 Superposition Rule 

Suppose that the process input is a linear combination of several signals. Then, the process 
output is the linear combination of the respective process outputs for the several signals if 
the process is linear. For example, the process output >(?) for the process input u(t) = U\(t) + 
0.3m 2 (0 + 1 .3m 3 (0 can be obtained without a plant test from the available information that the 
process is linear and the process outputs >i (t), y 2 (t) and > 3 (f) are the responses of the process to 
the process inputs u 2 (t) and w 3 (f) respectively. That is, it is clear that the process output is 
y(t) = y t (t) + 0.3> 2 (i)<|i*Sl.3> 3 (t) for the given process input u(t) by the superposition rule 
(Figure 1.5). 


ui(0 


U 2 (t) 


u 3 (.t) 


Figure 1.5 Superposition principle. 




u(t) = u,(f) + 0.3 u 2 (t) + 1.3 u 3 (t) 
y(t) = y,(t) + 0.3y 2 (t} + ^.3y 3 (f) 


Therefore, if the pairs ( u 3 (t ), y\(t)), ( u 2 (t ), y 2 (t)), (u 3 (t), y 3 (t)),... for the given linear process 
are known, then >(?) can be easily calculated corresponding to any u(t) of a linear combination 
Mr(4 u 2 {t), u 3 (t), .... 


Example 1.14 

Obtain the process output >’(0.0), y(0.1), >(0.2), >(0.3) of a linear process for the following 
process input u(t): 

u(t) = 2 fort>0, u(t) = 0 fort<0 (1.30) 

The available information is that the responses of the process to the process input Ui(t) = 1 
for t > 0, Mr (?) = 0 for t < 0 are >r(0.0) = 0.0, >r(0.1) = 0.01, >r(0.2) = 0.02 and >r(0.3) = 0.04. 

Solution Note that u(t)=2ui(t). Then, y(t) = 2>|(t) by the superposition rule. So, 
>(0.0) = 0.0, >(0.1) = 0.02, >(0.2) = 0.04 and >(0.3) = 0.08 are obtained. 
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Example 1.15 

Obtain the process output y(0.0), >(0.1), >(0.2), >(0.3) of a linear process for the following 
process input u(t): 

u(t) = 1 for t > 0.1, u{t) = 2 for0 < (< 0.1, u(t) = 0 for(<0 (1.31) 

The available information is that the responses of the process to the process input U\(t) = 1 
for t > 0, U\{t) = 0 for t < 0 are >i(0.0) = 0.0, yi(0.1) = 0.01, >i(0.2) = 0.02 and >i(0.3) = 0.04, 
and the responses for the process input 112(1) = 1 for t > 0.1, u 2 (t) = 0 for t < 0.1 are >’2(0.0) = 
0.0, > 2 (0.1) = 0.0, > 2 (0.2) = 0.01 and > 2 (0.3) = 0.02. 


Solution Note that u(t) = 2u\(t) — u 2 {t). Then, y(t) = 2y,( t) — y 2 (t) by the superposition rule. 
So, >(0.0) = 0.0, >(0.1) = 0.02, >(0.2) = 0.03 and >(0.3) = 0.06 are obtained. 


Example 1.16 

Obtain the process output >(0.0), >((). 1), >(0.2), >(0.3) of a linear time-invariant process for the 
following process input u(t): 

u(t) = 0 for t > 0.1, u(t) = 1 for0 < (< 0.1, u(t) = 0 fort<0 (1.32) 

The available information is that the responses of the process to the process input U\(t) = 1 
for t > 0, U\(f) = 0 for t < 0 are >i(—0.1) = 0.0, >i(0.0) = 0.0, >i(0.1) = 0.01, >i(0.2) = 0.02 and 
yiCO.3) = 0.04. 


Solution Note that u(t) = U\(t) — u x (t — 0.1). Then, y(t)=y l (t) — y\(t — 0.1) by the superpo¬ 
sition rule. So, >(0.0) = 0.0, >(0.1) = 0.01, >(0.2) = 0.01 and >(0.3) = 0.02 are obtained. This 
example demonstrates how to obtain the impulse responses from the step responses. 


Example 1.17 

Obtain the process output >(0.0), >(0.1), >(0.2), >(0.3) of a linear time-invariant process for the 
following process input u{t)\ 

u(t) = 3 for0.2 < t, u{t) = 4 for0.1 < (<0.2, u{t) = 2 

forO < f<0.1, u(t) = 0 for f < 0 (1.33) 

The available information is that the responses of the process to the process input U\(t) = 0 
for f>0.1, Mi(()=l for 0<(<0.1, Ui(t) = 0 for (<0 are >i(—0.2) = 0.0, > t (—0.1) = 0.0, 
>!(0.0) = 0.0, >i(0.1) = 0.01, >i(0.2) = 0.03 and >i(0.3) = 0.02. 


Solution Note that u{t) = 3u\(t — 0.2) + 4m,(( — 0.1) + 2u\(t). Then, >(() = 3>i(( — 0.2) + 
4>i(( — 0.1) + 2> 1 (() by the superposition rule. So, >(0.0) = 0.0, >(0.1) = 0.02, >(0.2) = 0.10 
and >(0.3) = 0.19 are obtained. This example demonstrates how to calculate the process output 
from the impulse responses of the process. This kind of model is called an “impulse response 
model.” 
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Example 1.18 

Obtain the process output y(t ) of a linear process for the process input u(t) = 3 sin(f) + 2 
sin(3f). The available information is that the responses of the process to the process input 
U\{t) = sin(f) are y i ( t) = 0.3 sin(t — 0.1) and the responses of the process for the process input 
u 2 {t) = sin(3f) are y 2 {t) = 0.1 sin(3t — 0.2). 

Solution Note that u(t) = 3wj(f) + lu 2 (t). Then, y(t) = 3>’,(?) + 2 y 2 (t) by the superposition 
rule. So, y{t) = 0.9 sin(f — 0.1) + 0.2 sin(3f — 0.2) is obtained. 

Example 1.19 

Obtain the process output y(t) of a linear time-invariant process for the process input u(t) = 
sin(t). The available information is that the responses of the process to the process input 
U\(t) = 0.4 sin(f — 0.1) + 0.2 sin(3t — 0.2) are yj (t) = 0.3 sin(t — 0.2) + 0.1 sin(3t — 0.4). 


Solution y(t) = 0.3 sin(f — 0.2) is obtained for u(t) = 0.4 sin(7 — 0.1) and, equivalently, 
y( t) = 3 sin(f — 0.1)/4 for u(t) = sin(f) from the given information and the superposition rule. 
Also, y{t) = sin(3t — 0.2)/2 is the response to the process input u(t) = sin(30- 

1.2.3 Linearization 

It is notable that many nonlinear processes can be approximated effectively by linearized 
models. Linearization is the process of obtaining a linear model to approximate the nonlinear 
model. Taylor series are frequently used for linearization. Theoretically, a nonlinear function 
f(u) can be represented by the following Taylor series: 


The following approximation of (1.34) to (1.35) is called linearization at u = uq. 


f(u) «/(m 0 ) + ^ (u - M 0 ) 


(1.35) 


For example, the straight line in Figure 1.6 corresponds to (1.35), which is close to (1.34) 
around u = u 0 . 



Figure 1.6 Linearization of/(«) at u=u 0 . 
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Equation (1.22) can be approximated by the Taylor series at u{t) = u 0 = 1 as follows: 

^-y(/) = 4^(0.« 4^o + 4 l -(u 0 r l/2 (u(t) - u 0 ) (1.36) 

Equation (1.36) can be rewritten to the following linearized process: 

^ +y(t) « 20^ + 2 (uo)- l/2 u(t) (1.37) 

Equation (1.37) can be also described by the deviation variables: 

+y(i) = 2 (m o )“ 1/2 m(0, y(t)=y(i)-y^ u(t) = u(t) - u ss (1.38) 

Now, the linearized process (1.38) is obtained for the nonlinear process (1.22). 

The Taylor series approximation can be also applied to multivariable nonlinear functions 
such as/(wi, u 2 ) as follows: 

f(u u u 2 ) ~/(wi,o,W2,o)+^j (wi-wi i0 )+^| (M2-W2,o) (1.39) 

Similarly, the Taylor series approximation can be applied to multivariable functions of which 
the number of the variables is bigger than 2 in a straightforward manner. 

Example 1.20 

Obtain the linearized process around u(t) = u 0 = 2 for the following nonlinear process, and 
express it with the deviation variables: 

6 ^+y l \t) = u\t) (1.40) 

Solution Equation (1.40) becomes y 15 (t) = u 3 (t) at steady state. So, the value of the process 
output y(t) for u{t) = u 0 = 2 is y 0 = 2 3/1 ' 5 . We obtain y L5 (t) ~8 + 3(y(t) — 2 3/15 ) and u 3 (t )« 
8 + 12(m( 0 — 2) by the Taylor series approximation. Then, the linearized process is 

d ^+8 + 3(y(f)-2 3 / 1 ' 5 ) = 8+12 (k(0-2) (1.41) 

Equation (1.41) is valid for the steady state. That is, the following equation is valid: 

^ + 8 + 3(y 0 « - 2 3/L5 ) = 8 + 12(«d(/) - 2) (1.42) 

So, the following linearized process represented by the deviation variables is obtained by 
subtracting (1.42) from (1.41): 

d ^+.3y(/)=12u( f ) (1.43) 


y(t) = y(t)~ 2 3/1 - 5 , «(0 = «( 0 - 2 


( 1 . 44 ) 
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Example 1.21 

Obtain the linearized process around u(t ) = u 0 = 2 for the following nonlinear process, and 
express it with the deviation variables: 

dy ^+ym+0.lu 2 (t)) = u\t) (1.45) 

Solution Equation (1.45) becomes y(/)(l + 0.1 u 2 (t)) = u 3 (t) at steady state. So, the value of 
the process output y(t) for u(t) = w 0 = 2 is >’ 0 = 8/1.4. The following equation is obtained by the 
Taylor series approximation for the multivariable function y(f)(l + 0.1 u 2 (t)): 

y(t)(l + 0.1 u 2 (t)) « y 0 (l + O.Imq) + (1 + 0.1^)(y(t) -y 0 ) + 0.2y 0 u 0 (u(t) - u 0 ) 

= 8 + 1.4(y(/) - ^ + ^(«(0 -2) (1.46) 

and u 3 (t) w8 + 12 (u(t) — 2) by the Taylor series approximation. Then, the linearized process 
is as follows: 


+ 8 + l-4^y(f) - + y^( H (0 _2 ) — 8+ 1 2(m(i) -2) (1-47) 

Equation (1.46) is valid for the steady state. That is, the following equation is valid: 

^ +8+ l.4^yo(0 - + yy(wo(0 -2) = 8+ 12 (uo(t) -2) (1-48) 

So, the following linearized process represented by the deviation variables is obtained by 
subtracting (1.48) from (1.47): 

® + 1.4y(t)=(l2-^M(t) (1.49) 

y(t)=y(0- 8/1-4, u(t)=u(t)-2 (1.50) 

Example 1.22 

Obtain the linearized process around u(t) = u 0 = 2 for the following nonlinear process and 
express it with the deviation variables: 

d ^+2 d f + , W +0.01 d f„(, W «) = »(«) (1.51) 

Solution Equation (1.51) becomes y{t) = u{t) at steady state. So, the value of the pro¬ 
cess output y(t) for u(t) = u 0 = 2 is y 0 = 2 and the value of dy(t)/dt at steady state is zero. 
So, the linearization should be done around Uo = 2,y 0 = 2 and (dy(t)/dt)o = 0. The following 
equation is obtained by the Taylor series approximation for the multivariable function 
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O.Ol(dy(t)/dt)u(t)y(t). Here, dy(t)/dt should be considered one of the variables of the nonlinear 
function 0.01 (dy(t)/dt)u(t)y(t). Also, 0(0.01 (dy(t)/dt)u(t)y(t))/du(t) = 0 and 8(0.01 (d>(?)/ 
d t)u(t)y(t))/dy(t) = 0 at steady state should be used. 

Qm^u{t)y{t) « O.Ol^o^ -o) = 0.04^ (1.52) 

Then, the linearized process is as follows: 

^ + 2 04^ +,(,) = «(» (1.53) 

Equation (1.53) is valid for the steady state. That is, the following equation is valid: 

+»« = ».«) (1.54) 

So, the following linearized process represented by the deviation variables is obtained by 
subtracting (1.54) from (1.53): 

■fM+2.04® + *,) = »(» (1.55) 

3 >( t )=y( t )~ 2 > u{t)=u(t)~ 2 (1.56) 


1.3 Laplace Transform 

The Laplace transform plays an important role in analyzing/designing the control system. In 
this section, the definition of the Laplace transform is introduced. Also how to obtain the 
Laplace transforms for various functions and how to solve differential equations using the 
Laplace transform are explained. 

1.3.1 Laplace Transforms, Inverse Laplace Transforms 

The Laplace transform of ft) is defined as 

L{f(t)} =f(s) = exp(-.«)/(/) d t (1.57) 

where s is a complex variable./^) or L[ft) } denotes the Laplace transform of ft). Note that/L) 
is a function of s because it is the integral of exp (—st)f(t) from t = 0tot=°°, which means that 
the variable t disappears. 

The inverse Laplace transform restores the original function/ft) from the Laplace transform 
of ft): 




(1.58) 
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The following examples demonstrate how to obtain the Laplace transforms for several 
functions. Also, several important properties of the Laplace transform are shown. 

Example 1.23 

m= 1: 

= /(*) = [ exp(-jf) d t = - exp( ^ 1 = ' (1.59) 

Jo s lo s 

Example 1.24 

fit) = e. at : 

L{f(t)}=f(s)= [ exp(-sf)exp(af)df = [ exp[- (s-a)t] At = - ——— —I =—— 

Jo Jo s ~ a lo s ~ a 

(1.60) 

Example 1.25 

The Laplace transform satisfies the following linearity: 

L{ag{t) + bh{t)} = | exp(-st)(ag(t) +bh(t)) At 

= a exp(— st)g(t) At + b\ exp(- st)h{t) df 
Jo Jo 

= aL{g(t)} + bL{h(t)} = ag(s) + bh(s) (1.61) 

The linearity of the Laplace transform is used in Examples 1.27-1.29. 

Example 1.26 

/(fj = Cosh(fl0 = exp(<l 0 +^ ex P ( ~ a 0 . 

Example 1.27 

f(t) = sinh(af) = ex P (a 0 ~^ exp( ~ ; 

f(s) = ^L{exp(af)} - ^L{exp(- at)} = ^ 


(1.63) 
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exp(itof) + exp(— i wt) 


f(s) = -L{exp(iwt)} + -L{exp( — iwt)} = 


exp(iwt) — exp(— io>f) 


f(s) = — L{exp(i<wt)} - — L{exp(-iwl)} = 


Example 1.30 

Relationship between L[txp(at)f(t)} and L{ftt )}: 


L{exp(at)f(t)} = exp(— st)exp(at)f(t) dt = exp[- (s-a)t\f(t) dt =f(s-a) 


The property of the Laplace transform of Example 1.30 is used in Example 1.31. 

Example 1.31 

f(t) = exp(af)cos(«t) and/(t) = exp (at) sin (cat): 

L{exp(at)cos(a)t)} = ^ ^ , L{exp(at)sin(wf)} = --^-- 

(s-a) +w 2 ( s-a) +(o 2 

Example 1.32 

Relationship between L{fj and L{t" -1 }: 


L{f} = t"exp( — st) At = 


t" 1 exp(— st) dt = L{t n 


It is straightforward to obtain (1.69) from (1.68): 


if n is an integer 


(1.69) 
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Example 1.33 

Numerical estimation of G(s) = y(s) /u(s) at s = 3i for the given u(t) and y(t). 
From the definition of the Laplace transform, we have (1.70) and (1.71): 


u(s = 3i) = 

J exp(— 3it)u(t) dr 

(1.70) 

y(s = 3i) = 

[ exp( - 3ir)y(r) dr 

Jo 

(1.71) 


Equations (1.70) and (1.71) can be numerically calculated by a numerical integration 
method if u(t) and y(t) converge to zero as t increases. Then, it is straightforward to calculate 
G(3i) = >’(3i)/w(3i). This example shows how to estimate the frequency responses of the process 
from the measured process input u{t) and the process output y(r). Detailed descriptions on 
numerical integration methods and frequency response estimation methods will be given later 
in this book. 


1.3.2 Laplace Transforms for Derivatives and Integrals 

The Laplace transform of the derivatives of a function can be expressed by the Laplace 
transform of the function and the initial conditions, as shown below. 


‘fm 


exp( — st) d? = exp( — st)f(t) 


h; 


exp (-st)f(t) dr 


= ,L{/(r)}-/(0) 


(1.72) 

(1.73) 






d"- 1 /(Q | 


(1.75) 

(1.76) 
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The Laplace transform of the integrals of a function can be expressed by the Laplace 
transform of the function, as shown in (1.77): 

l{I o /W dT j = exp( - st) J o /(r) dr At 

= - 1 cxp( - si) f /( t ) dr I + - [ exp (-st)f(t) d t = — (1.77) 

s Jo lo s Jo s 

The following examples show how (1.76) is used to convert the differential equation in the 
time domain to the algebraic equation in the 5 domain. 


Example 1.34 

Consider the following differential equation: 


d 3 y(t) d 2 y(t) d y(t) d 2 u(t) d u(t) 

-fV 1 +y(0 = —A 1 +3—^ + u (t) 

d t 3 d t 2 At At 2 dt 


where the initial conditions are 


d 2 y{t) 

At 2 /= 


dy(Q 

At t=0 


= y(o) = o, 


d«(p 

At t __ 


= u( 0) = 0 


(1.78) 


If the Laplace transform is applied to (1.78), then (1.79) is obtained by (1.76): 


s 3 y(s) + 3 s 2 y(s) + 3sy(s) +y(j) = s 2 u{s) + 3 su(s) + u{s) 

y(^) _ s 2 + 3,? + 1 
u(s) s 3 + 3s 2 + 3s + 1 


(1.79) 

(1.80) 


Example 1.35 

Consider the differential equation: 


d 3 y(f) . ,d 2 y(t) 
d? 3 dr 2 


, dy(0 


+y(0 = 


A 2 u(t) „ Au(t) . . 


where the initial conditions are 


(1.81) 


d 2 y(t) 


= 0 , 


dy(Q 

At t 


= 0.L 


y(0) = 0, 


Au(t) 
d? t 


u( 0) = 0 


If the Laplace transform is applied to (1.81), then (1.82) is obtained by (1.76): 

j 3 y(j) — 0.b’+ 3i’ 2 y(s) — 0.3 + 3ay(,s’) +y(j) = s 2 u(s) — 1 +3jm(j) +u(s) (1.82) 


Example 1.36 

Consider the following integro-differential equation: 


d 2 y(t) 
Atfi 


d y(t) 

At 


+y(t)= -0.1 


d u(t) 
At 


u(t)+ f«(T) 
Jo 


dr 


(1.83) 
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where the initial conditions are 


4v(0| 


= y(0) = 0 ,k(0) = 0 


If the Laplace transform is applied to (1.83), then (1.84) is obtained by (1.76) and (1.77): 


f'yis) + sy(s) +y(s) = - O.lra(i) + u(s) + U ^- 


(1.84) 


Example 1.37 

The differential equation corresponding to the algebraic equation (1.85) is (1.86): 

fy(s) +2jy(s) +y(j) = - su(s) + u(s) + 0.5 — (1.85) 


d 2 y{t) 
At 2 




»w 


f 0.5 1 u(t) dr, 


dy(Q | 


= y(0)=0, «(0) = 0 


( 1 . 86 ) 


1.3.3 Laplace Transform for Unit Step Function, Time Delay and 
Impulse Function 

The definition of the unit step (Figure 1.7) function is 

*«-«>-{? £>/ <‘- 87 > 

The Laplace transform of the unit step function S(t — 6) is 

l{S((-9)}= fexp(- s ,)«(<-») d<= r e xp(-«)d>=- eXP( ~ J<) r= eXP( ~ fo) 

Jo Je s \ $ s 

( 1 . 88 ) 


Figure 1.7 Unit step function. 
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e 6+m 

Figure 1.8 Impulse function. 

The time-delayed function/(f — 0)S(t — 0) has the following Laplace transform: 

L{f(t—0)S(t—0)}=\ exp( — st)f(t— 0)S(t — 0) At = [ exp( — st]f(t — 0) At (1.89) 
Jo Jt=6 

Substituting x = t — 9, the following Laplace transform is obtained: 

L{f(t-0)S(t-6)}= f exp[- s(x + 6)]f(x) dx 

Jx=D 

= exp(— 0s) [ exp(— sx)f(x) Ax = exp( - 0s)L{f{t)} = exp( - ds)f(s) 


The unit impulse function (Figure 1.8) is defined as 

8(t — 0) = Y\mf m (t — 0) 


Ut-0) 


= !Vm 


0<t < 0 + n 
otherwise 


The impulse function has the following Laplace transform: 

L{8{t — 0)}= [ exp( — st)8(t — 0) At = lim [ 

Jo 


+ exp( — st) A 


exp( — st) I 


exp( — 0i , )exp( — sm) exp( — 0^)1 


(1.90) 

(1.91) 

(1.92) 

(1.93) 


L{S(t)} = 1 


(1.94) 

(1.95) 


Example 1.38 

The algebraic equation (1.96) in the Laplace domain is equivalent to the differential equation 
(1.97) in the time domain: 

+ 35y(5) +y(^) = 2su(s)exp(— 2s) + w(,s)exp(— 2^) 


(1.96) 
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d 2 y(t) 

d t 2 


, <M0 


y(t) - 


^du{t-2) 


S(t-2)+u(t-2)S(t-2) 


(1.97) 


Also, note that 2[du(t — 2)/At]S{t — 2) + u(t — 2)S(t — 2) is equivalent to 2 [du(t — 2)/At] + 
u(t — 2) with u(t) = 0 for t < 0. So, (1.97) can be rewritten: 


d 2 y{t) 

d t? 

dy(Q | 

At 


= y(0) = 0, u{t) = 0 for t < 0 


(1.98) 


Example 1.39 

The algebraic equation (1.99) in the Laplace domain is equivalent to the differential equation 
(1.100) in the time domain: 

s 2 y(s) + 3 sy(f); + y(s) = 2exp(- 3s) (1.99) 

d ^> + 3«i +J (,) = 2 S (,-3) (1.100) 

1.3.4 Differentiation and Integration of Laplace Transforms, Convolution 

From L{f(t)} =f(s) = exp(- st)f(t)At, we obtain 

Jo 

^As^ = lo _ ?eXp(_ St ^ dt = ~ I 0 exp ( _st )^ dt = ~ 

So, the Laplace transform of tfit) is obtained by differentiating the Laplace transform of fit) 
as follows: 


L{tf{t)} = - 


ds 


( 1 . 101 ) 


Meanwhile, the Laplace transform of fit)/t can be obtained by integrating the Laplace 
transform of fit): 
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Then: 


L {^} = I/ (S)dS (L102) 

Consider the following equation to derive the convolution theorem: 

f(s)g(s) = J exp(— ST)f(r)g(s) dr = j /(r)exp(- «■)*(*) dr 

= [ /(r)exp(- st) [ exp(— .sx)g(x) Ax dr (1.103) 

Jo Jo 

Equation (1.103) can be rewritten by using t = x + t and changing the order of the 
integration as follows: 

f(s)g(s) = j /(r) | exp(— st)g(t - r) d t dr = | J exp(- st)f(r)g{t - t) d t dr 
= 1 cxp (- v0{ J' o /( T )A>(,-r) drj At 

(1.104) 

So, the following convolution theorem is derived: 

M/WWsW} =f{s)g{s) = e- st ^J(T)g(t-T)dT^dt = L^J(T)g(t-T)dT^ 

(1.105) 


Example 1.40 

The Laplace transform of fexp( — 'it) is 


d 

ds 


by (1.101). 


mH 


Example 1.41 

The Laplace transform of exp(— it) is 


J,- (j + 3) 2 




Example 1.42 

The convolution theorem means that L{Jo/(r)g(t — t ) dr} =f(s)g(s). For example, the 
inverse Laplace transform of l/[(,s + 3)(s + 1)] is 


exp( — 3r)exp( — t + r) dr 
Jo 


exp( 


-or 

Jo 


exp( — 2 t ) dr = 


exp(— 3?) exp(— t) 
2 2 
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1.3.5 Laplace Transform of Periodic Functions 

Assume that/(0 is a periodic function of which the period is p. Then, the followings are valid: 


f(s) = | exp( - st)f(t) d t = J exp(— st)f(t) At + 
(-3 p r 4 P 

+ exp(— st)f(t) At + exp(— st)f(t) At + • • • = 

hp hp 

t 2 P fP f 4 P 

+ exp(-st)f(t-p) At + exp( — st)f(t — 2p) At + 

Jp J2p J3p 


f exp( — st)f(t) At 

J P 

= | exp(- st)f{t) At 
exp(- st)f(t - 3p) At+ ■ ■ ■ 


Substituting r=t—p, we find 


(1.106) 


1*2 p 

exp(— st)f{t — p) At = exp(- sp) 

Jp 


[ exp(— sr)f(r) At 

lo 


Similarly, we obtain 


[ exp(— st)f(t — 2p) At = exp( — 2sp) [ exp(- sfff) dT 

Jip Jo 


f(s) = [ exp(- st)f(t) At + exp( - sp) [ exp( - ot)/(t) dr + exp( - 2 sp) x 
Jo Jo 

exp( - 5t)/(t) dr + exp( - 3 sp) exp( - st)/(t) dr + • • • = (1 + exp( - sp) + exp(— 2 sp) 

Jo Jo 

+ exp(— 3sp) H- )f exp(-st)f(t)At = - -'- rf exp(-st)f(t)At fors>0 

Jo 1 -exp(-^p) Jo 

(1.107) 

So, the Laplace transform of a periodic function can be calculated if the function values of 
only one period are given. 

1.3.6 Taylor Series and Pade Approximation of Time Delay 

The Laplace transform of the time delay term S(t — 0) is exp(— Gs). The Taylor series is 
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is obtained and 


u(t - 6)S(t -6) = u(t) + Y] 


(-0)’ d'»(gf 
i\ W 


equivalently. Now, we realize that the delayed signal can be represented by a linear 
combination of the derivatives of the original signal. 

The approximation of 

f(s) = exp( - 9s) ^ « 1 - 6s 


is called the Taylor series approximation and 


/0) = exp( - 6s) = 


exp( — 0.50s) 
exp(O.50s) 


1 - 6s/2 
1 + 6s 1 2 


is called the Pade approximation. This means that the delayed signal of g(t) = u(t — 6)S(t — 6) 
can be approximated like 

g(t) = u(t - 6)S(t - 6) « u{t) - 6 


or 




6dg(j) 

2 d t 


«( 0 - 


6du(t) 

2^dr 


1.3.7 Partial Fractions 

Partial fractions are very useful to restore the original function in the time domain from the 
Laplace transform in the Laplace domain. Consider the following examples. 


Example 1.43 

Obtain the inverse Laplace transform for the following Laplace transform: 


>’(•«) = 


■s + 2 

.v(.v+ 1)0-2) 


(1.108) 


Solution y(s) can be rewritten in the following form if the roots of the denominator are not 
repeated: 


j0) = - 


s+2 


b 

h 7+i " 


(1.109) 


s(s+ 1)0-2) 

a = — 1 is obtained by putting s = 0 in (1.110) after multiplying by s on both sides of (1.109): 
s+ 2 sb sc 


0 + 1 ) 0 - 2 )“ 


s+l 


( 1 . 110 ) 
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Similarly, b = 1/3 by putting s=— 1 in (1.111) after multiplying by s + 1 on both sides of 
(1.109): 


s + 2 _(s+l)a (s+l)c 

s(s-2) s + + s+3 


( 1 . 111 ) 


Similarly, c= 2/3 by putting s = 2 in (1.112) after multiplying by s— 2 on both sides of 
(1.109): 


(.s + 2) _ (s-2)a (s-2)b 

s(s+l) s 5+1 


Then: 

y(s) = 


5(5 + l)(s-2) 


( 1 . 112 ) 


-1 , 1/3 2/3 

s s+l s-2' 


y(t ) = - 1 + ^exp( - i) + - exp(2/) 

(1.113) 


Example 1.44 

Obtain the inverse Laplace transform for the following Laplace transform: 


y(s) = 


.s 3 - 4s 2 + 4 
s 2 (s-2)(.s- 1) 


(1.114) 


Solution y(s) can be rewritten in the following form if some of the roots of the denominator 
are repeated: 


s 3 — 4s 2 + 4 a 2 ai b c 
y{s) ~ si{s-2){s-\)-£ + ^ + J^2 + —\ 


(1.115) 


b = — 1 is obtained by putting s = 2 after multiplying by s — 2 on both sides of (1.115). In a 
similar way, c = — 1 and a 2 = 2 can also be obtained. 

To obtain a.\, multiply by s 2 on both sides and differentiate both sides with respect to s. 
Finally, put s = 0. 


.s 3 — As 2 +4 s 2 b s 2 c 

7-317-7T = a 2 + sai H-- H-- 

(s — 2)(s— 1) s—2 s— 1 


(1.116) 


d ’ s 3 — As 1 + 4 ' d / s 2 b \ d / s 2 c \ 

ds [(s - 2) (s - 1) J “ Ql + ds \s - 2 ) s=0 + ds V - V s=0 


(1.117) 


where it is noted that 
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because they include s 2 . So, the following simple equation is obtained: 


d r y 3 - 4s 2 + 4 ' 

d s b-2)(i-l)J, =0 


= 3 = a\ 


Finally, the following inverse Laplace transform is obtained: 


(1.118) 


5 3_ 4i y2 + 4 3_ 1 

5 2 (5-2)(i-l) _ j 2 + 5 5-2 


y(t) =2t + 3- exp(2f) - exp(t) 

(1.119) 


Example 1.45 

Obtain the inverse Laplace transform for the following Laplace transform: 


y(5) = 


2 

(5 2 + l)(5+l) 3 


( 1 . 120 ) 


Solution y(s ) can be rewritten in the following form if the complex roots of the denominator 
are not repeated: 


y(S = 


2 

(5 2 +l)(.V+l) 3 


a\s + a 2 
s 2 + 1 


bj 

(*+l ) 3 


‘ bi 

(*+l) 


( 1 . 121 ) 


As discussed in the Example 1.43, multiply (5 + l) 3 on both sides as shown in (1.122) and 
put s = — 1 to obtain Z> 3 = 1. As discussed in Example 1.44, multiply by (s + l) 3 on both sides 
and differentiate both sides with respect to s, as shown in (1.123), and put 5= —1 to obtain 
*2=1. 


2 

v 4-1 


(.v+ l) 3 (fli-v + fl 2 ) 

,v 2 + 1 


+ £3 + £2(5 + 1) + b\ (5 + 


l) 2 


d 

dy 



d ( 5 + \f{ais + a 2 ) 


+ b?. — {s-\- l)| i= _ 


( 1 . 122 ) 


+ b\ — (5 + 1) |^_ _ j — bi (1.123) 

To obtain b\, multiply (5 + l) 3 on both sides and differentiate both sides twice with respect 
to y, as shown in (1.124). Finally, put 5= —1 and obtain b\ = 1/2. 


d 2 (5+ l) 3 (ai5 + a 2 ) 
dy 2 ■S l +1 


+ 6 1 - t (5+!) 2 | 


= 2 bi 


(1.124) 


ds 2 \s 2 *F 1 
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Then, we obtain 


= 


2 

0 2 + l)(.s+ l) 3 


a\s + ci2 
s 2 +1 


1 1 


1/2 

(*+l) 


Equivalently: 

2 * + a 2 )(s + l) 3 + ( s 2 + 1) + ( s 2 + l)(j + 1) + -^-— (1.125) 

The following equations are obtained by comparing the two terms corresponding to the 
fourth and third order. 


s 4 : 0 = 1/2 + fli 

5 3 : 0 = 1 + 1 + 3ci\ + 0-2 


(1.126) 

(1.127) 


2 _ -1/25-1/2 ?■€. 1/2 

3,1S ~ (5 2 +l)(.V+l) 3 “ ?+l + (5+1) 3 + (.V+l) 2 + S+l 


(1.128) 


/N cos(f) sin (f) 9 exp( — t) , N exp( — t) 

y(t) = -- + f 2 ^—L + 1 exp( - i) + —— 2 


(1.129) 


1.3.8 Solving Differential Equations 

The following examples demonstrate how the Laplace transform can be applied to solve 
differential equations. Note that the Laplace transform is used to convert differential equations 
in the time domain to algebraic equations in the Laplace domain. It is relatively easy to obtain 
solutions in the form of the Laplace transform by solving the algebraic equations. Finally, the 
solution in the time domain can be obtained with the inverse Laplace transform of the solution 
obtained in the form of the Laplace transform. 

Example 1.46 

Let us solve the following differential equations using the Laplace transform: 

^=-y(t) + l, y(0) = 0.5 (1.130) 

Equation (1.131) is obtained by applying the Laplace transform to (1.130): 


sy(s) -0.5 = -y(s)+ - 


(1.131) 
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Equation (1.131) is rewritten a 


Then, the ultimate solution in the time domain is obtained by applying the inverse Laplace 
transform to (1.132): 


y{t) = 1 - 0.5exp( - t) 


Example 1.47 

Let us solve the following differential equations using the Laplace transform: 


0 . 5 ), ^ 


= y(0) = 0 (1.134) 


The Laplace transform of (1.134) i: 


v 2 y(.v) — 2sy(s) +y(j) = 


Equation (1.135) is rewritten a 


exp(—0.5y) (1.136) 


Then, the inverse Laplace transform of (1.136) results in the following solution: 

y{t) = {1 — exp[ — (f — 0.5)] — (f — 0.5)exp[ — (f — 0.5)]}5'(t — 0.5) (1.137) 


Equation (1.137) is equivalent to the following representation: 


- exp[ — (f — 0.5)] — (t — 0.5)exp[ — (f — 0.5)] t > 0.5 

t< 0.5 


Example 1.48 

Let us solve the following differential equations using the Laplace transform: 


yi(0) = 0, y 2 (0) = 0.5 


(1.141) 
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The following algebraic equations (1.142)—(1.145) in the Laplace domain are obtained by 
applying the Laplace transform to the differential equations. Equations (1.146) and (1.147) are 
the solutions obtained by solving the algebraic equations (1.144) and (1.145). Equations 
(1.148) and (1.149) are the ultimate solutions in the time domain, found by the inverse Laplace 
transform of the algebraic equations (1.146) and (1.147). 


(0) = - yi (s) + 2y 2 (j) + ' 

■vj2(-v) -^(O) = 2y x {s) + 2y 2 (s) 

(?+ l)yi (^) -2y 2 (s) = i 

- 2yi (s) + (s-2)y 2 (s) = 0.5 

s-2 1 1/3 4/15 3/5 

yi 5(5 — 3) (5+ 2) (s— 3) (5+ 2) s ~*~5 —3 s + 2 

2 1/2(5+1) _ —1/3 8/15 3/10 

y2 ^ 5(5-3) (5 +2) + (j-3)(j + 2) 5 + 5-3 + 5 + 2 

1 , 4exp(3t) 3exp(-2 1) 

yi{t) = 3 + ~[5 -5- 

1 8exp(3t) 3exp( - 2 1) 

m> 3 15 10 


(1.142) 

(1.143) 

(1.144) 

(1.145) 

(1.146) 

(1.147) 

(1.148) 

(1.149) 


1.3.9 Relationship between Laplace Domain and Time Domain 

A lot of the literature on process dynamics and control uses the Laplace transform to explain 
the core algorithms and signal flows. On the other hand, there is a need to understand the 
algorithms and signal flows in the form of differential equations to simulate or implement 
them. Thus, it is important to understand exactly the relationship between the Laplace 
domain and the time domain. If the formula derived in this chapter is used, then the algebraic 
equations in the Laplace domain can be obtained from the differential equations in the time 
domain, and vice versa. Refer to the following examples. 


Example 1.49 

The equation 


u(s) = 1.5e(5) 


(1.150) 
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is equivalent to 


u(t) = 1.5 e(t) 


(1.151) 


Example 1.50 

The equation 


= 


(5j + 4)exp(-0.1j) 

35 2 + 25+l U[ - S) 


is equivalent to the following differential equations: 

d 2 y{t) 

d t 2 ' " d t 


f 4«(f-0.1) 


(1.152) 


(1.153) 


dy(Q 

d ? ,=o 


= j(0) = 0, 


u(t) = 0 for / < 0 


(1.154) 


Example 1.51 

The equation 

u(s) = 1.2^1+ ^+2.0^) (1.155) 

is equivalent to the following differential equation: 

«(0 = 1.2*(0+ J ^ ) |' e (T)dT+1.2x2.0 d ^, e(0) = 0 (1.156) 

Example 1.52 

The multivariable equation 

“ W ” L2 (' + Tos) e ' (l) + 0 2 (‘ + 3os) ejW 

is equivalent to the following differential equation: 

u{t) = 1.2ei(0+ ^| o ^t(r) dr + 0.2e 2 (t)+ dr 


1.4 Transfer Function and State-Space Systems 

The transfer function is a simple and useful tool to represent the relationship between the 
process input and the process output. The state-space representation is required to simulate the 
dynamics of the given transfer function. 


(1.157) 

(1.158) 
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1.4.1 Transfer Function 

The transfer function from u{t) to y(t) is defined as the Laplace transform of y(t) over the 
Laplace transform of u{t) assuming that the initial values are zero and steady state (denoted by 
the term initial zero-steady-state). 


G{s) = 


y(?) 

u(s) 


(1.159) 


If u(t) and the other variables simultaneously affect y(t), then the other variables should be 
assumed zeroes to obtain the transfer function from u{t) to y(t). Refer to the following 
examples. 


Example 1.53 

Obtain the transfer function from u(t) to y(t) for the process 


d 2 y(Q 

d/ 2 


+2 m 

d t 


+y(t ) = 3 


d U{t) 
d t 


+ u{t) 


(1.160) 


Solution Assuming the initial zero-steady-state (that is, dy(t)/dtl i= o = >(0) = 0, u( 0) = 0), the 
Laplace transform (1.161) and the transfer function (1.162) are obtained: 

s 2 y(s ) + 2 sy(s) + y(s) = 3 su(s) + u(s) (1.161) 


yfo) = 3s +1 
w(s) s 2 + 2s + 1 


Example 1.54 

Obtain the transfer function from u(t) to y(t) for the process 


“^+ 2 ^ +,(<) = 3 ^ 

d t 2 At At 


+ u{t — 2) 


(1.162) 


(1.163) 


Solution Assuming the initial zero-steady-state (that is, Ay{i)IAt\ t= o = y(0) = 0, u(t) = 0 for 
t < 0), the following Laplace transform (1.164) and transfer function (1.165) are obtained: 


s 2 y(s) + 2sy(s) +y(.y) = 3,yw(,s , )exp( — 2s) + j/(s)exp( — 2s) (1.164) 


y(s) _ (3s + l)exp( - 2s) 
m ( s ) s 2 + 2s + 1 


Example 1.55 

Obtain the transfer function from u(t) to y(t) and the transfer function from v(t) to y(t) for the 
following process, noting that u{t) and v(t) simultaneously affect y(t): 


Ml + = 

At 2 At w At 


+ u(t — 2) + 2v(t — 1) 


(1.166) 
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Solution To obtain the transfer function from u(t ) to y(t), assume the initial zero-steady-state 
(that is, dy(t)/dt\ t=0 = >>(0) = 0, u(t ) = 0 for t < 0) and the variable v(t) = 0. Then, the 
Laplace transform (1.167) and the transfer function from u(t) to y{t) (1.168) are obtained: 

^y(s) + 2 sy(s) +y(j) = 3™(^)exp( - 2s) + M(s)exp( - 2s) (1.167) 


y(g) _ (3s+ljjligp(-2j) 
u(s) s 2 + 2s + 1 


(1.168) 


To obtain the transfer function from v(t) to y(t), assume the initial zero-steady-state (that is, 
Ay{t)IAt\ t=0 = }>(0) = 0, v(t) = 0 for t < 0) and the variable u(t) = 0. Then, the Laplace transform 
(1.169) and the transfer function from v(f) to y(t) (1.170) are obtained: 


^y{ s ) + 2jy(^) +y(5) = 2v(s)exp(-j) (1.169) 


yfr) _ ^exp( — s) 
v(s) s 2 + 2s + 1 


(1.170) 


Remark Equation (1.166) can be rewritten as follows using the superposition rule: 


d 2 y u (t) 0 d y u (t) 

At 2 At 


+y«(0 = 3 


Au(t — 2) 
At 


+ u(t- 2) 


(1.171) 


%W + 2^ + „(,) = 2v„-l) 


(1.172) 


y(t) =y«(0+yv(0 


(1.173) 


The transfer function from u(t) to y(t) corresponds to the transfer function from u(t) to y u ( t) 
and the transfer function from v(f) to y(t) corresponds to the transfer function from v(t) to 
y v {t). Now, it is clear from (1.173) that the relationship between the process output y(s) and 
the process inputs u(s) and v(s) can be obtained by adding the two transfer functions as 
follows: 


yCO = 


(3,+ l)exp(-2») aM + 


2exp( — s) 
s 2 + 2s+ 1 


vW 


(1.174) 


1.4.2 State-Space Systems 

The transfer function 


G(s) = 


yM 

u(s) 


b\s n 1 +Z?2‘S" "+•••+ b n -ij + b n 

-;-exp( 

s n + ais"~ l -\ - +a n -is + a v 
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is known to be equivalent to the following differential equations with the following initial 
conditions: 


A n y{i) d" l y{i) 


u(t) = 0 and 

y{t) = 0 and 


dyit) d" 1 u(t — 6) 

d ;_, 

+b„u(t — 6) 


d‘u(t) 


= 0, i = 1,2, — 2 for t <0 


d *y(Q 


= 0, z = 1,2, •••,«-! for f < 0 


(1.175) 

(1.176) 

(1.177) 


It is proven that the differential equation system (1.175)—(1.177) is equivalent to the 
following state-space system, which is called the state-space representation (realization): 

^^=Ax(t)+Bu{t-0) (1.178) 


y{t) = Cx(t) 


(1.179) 


x(0) = 0 


(1.180) 


where u{t — 6) and y(t) denote the delayed process input and the scalar process output 
respectively. x{t) is the n-dimensional state. Here, the system matrices are as follows: 


'0 0 0 ••• 0 -a„ 

1 0 0 ••• 0 — a„_ i 

0 1 0 ••• 0 — a „-2 


0 0 0 ••• 0 -a 2 

0 0 0 ••• 1 -ai 


(1.181) 


? =\b n b n _ i b n _ 2 


b 2 b x ] 


(1.182) 


C=[0 0 0 ••• 0 1] (1.183) 

Note that differential equation (1.175) cannot be solved directly by the usual ordinary 
differential equation solvers because the high-order differentials are included. This problem 
can be solved simply by the state-space representation. That is, the solutions y(t) of the 
differential equations (1.175)—(1.177) are easily obtained by solving the state-space model 
(1.181)—(1.183) with the usual ordinary differential equation solvers. 
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Equation (1.180) is valid for the case that all the initial values of the process input and the 
process output are zeroes, as shown in (1.176) and (1.177). If the initial values of u(t — 6 ) and 
y{t) are not zeroes, then (1.175) is equivalent to (1.178), (1.179) and (1.181)—(1.183) with the 
initial values x(0) of (1.184). 


*(0 )=X“V 


(1.184) 


>( 0 ) 

ctyl 

d'Lo 

#y\ 

At 2 | /=c 


CBu{- 0) 

- CABu(- G) - 


(1.185) 


d" l y 
dr - 1 t __ 


- CA n ~ 2 Bu{ -6)- CA n - 3 B—\ 
d? | 



* = 


C 
CA 
CA 2 


(1.186) 


Example 1.56 

Obtain the state-space process corresponding to the following process: 


d ^> + 2^+,(0 = 3^+*,-2) (1.187) 

=j(0) = 0, u(t) = 0 fort<0 (1.188) 

At l<=o 

Solution From (1.178)—(1.183), the state-space process is 

y(0 = [o (i.i90) 


x ( 0 ) = [0 0] 1 


(1.191) 
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Example 1.57 

Obtain the state-space process corresponding to the process 

2 ^ 2d di } + ^w = 2w(? - 2 ) ( L192 ) 

= y(0) = 0, u(t) = 0 for t < 0 (1.193) 

d/ Lo 

Solution Note that (1.192) should be converted to the standard form (1.175) by dividing 
(1.192) by 2.0. Then, from (1.178)—(1.183), the state-space process is 


-6/21 r 2/21 


UW+ \u(t-2) 

(1.194) 

— 2/2J L0 J 


y(t) = [0 r ]*(0 

(1.195) 

x(0) = [0 0] T 

(1.196) 


Example 1.58 

Obtain the state-space process corresponding to the process 


d 3 y(0 , , c d 2 y(t) 

df 3 d t 1 


3.2^ + ?«) 


du(t-O-S) 

d t 


u(t~ 0.5) 


(1.197) 


d 2 y(Q 
At 2 : f==0 


= y(0) = 0, u(t) = 0 for t <0 

dt t =o 


(1.198) 


Solution From (1.178)—(1.183), the state-space process is 



■o 0 

-l.o- 


'1 ' 

d*(Q _ 

At 

1 0 

-3.2 

x(t) + 

-2 


.0 1 

-3.5. 


.0 


y(0 = [o o i]x(t) 


( 1 . 200 ) 


*(o) = [o o o; 


( 1 . 201 ) 
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Example 1.59 

Obtain the state-space process corresponding to the process 

d 3 y(f) d 2 y(t) d y(t) d u(t — 0.5) 

-4*3.5 — f^-+3.2^-^+y(t) = -2——- -+u(t- 0.5) 


d 2 y(t) 

d f . 


4y(0| 


= -0.3, y(0)=0.5, u( — 0.5) = 1 


( 1 . 202 ) 

(1.203) 


Solution From (1.178), (1.179), (1.181)-(1.183) and (1.184)-(1.186), the state-space 
process is 


'0 0 -1.0' 


1 

1 0 -3.2 

x(t) + 

-2 

0 1 -3.5 


0 


(1.204) 


y (0 = [o 0 1]*(0 


(1.205) 


x (o) = x~ V 


(1.206) 


'0.5 ' 

t p= -0.3 

. 2.1 


X = 


0 

1 


-3.5 


1 

-3.5 

9.05 


(1.207) 


(1.208) 


Problems 

1.1 Figure P1.1 shows an aeration tank for wastewater treatment. Microorganisms in the tank 
remove the pollutants in wastewater. The dissolved oxygen (DO) in the wastewater 
should be controlled to a desired level to maximize the treatment performance of the 
microorganisms. The blower is to adjust the air flow-rate, which is proportional to the 
voltage v(t). DO is measured by the DO sensor. Determine the manipulating variable and 
the controlled variable for the DO control system. 

1.2 Figure PI.2 shows a schematic diagram for a level control. The valve is to adjust the flow 
rate and the DP cell measures the liquid level in the tank. Determine the manipulating 
variable and the controlled variable. 

1.3 The process output y(t) = 0.5 — 0.5(1 + t/2) exp(—1/2) is obtained for the process input 
u(t) = 1.0. Estimate the parameters of the following process: 
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influent 



influent 


liquid level i-1 

◄- DP — 

r~ 




- 

- s ~ 

— 


Figure P1.2 


^ +2T m +yW=hl(l) 

1.4 The process output y(t) = (1 /\/2)sin(2t — 37t/4) is obtained for the process input u 
(t) = sin(2f). Estimate the parameters of the following process: 

T ^ +y 7 ^ +iT m +yi ,- kuU) 


1.5 Obtain y(t ) at steady state for the following system: 
d 2 y(t) d y(t) 


+ ^ (2.o+o.i«(0)+X0 = o.i^ + VW) 


u(t) = 0.5(1 -y{t)) 
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1.6 Obtain >(f) at steady state for the process 

2< ^+ y (t) = (l+0Ay(t)) U (t) 

M (t)= 0.5(1-y(0)+0-25 d(1 ~ ? y(?)) 

1.7 Rewrite the following processes using deviation variables of which the reference value is 


>Vef = 0.0: 


§@P 


dt 


d t 


dt 2 f ^ d t ' "***** v<! '* dt 

1.8 Choose linear processes and determine if they are time invariant or time variant, 

d 2 y(Q , d>(t) _ ne du(t) 


(a) 


dt 2 


A d>(t) 
’ d t 
A dy(Q 


2 dy(0 , 

dt 

„d>(t) 


2 ^r +y{t} = 2u ^~ QA ^ = 0.5(1 -y(0) +0.2J'(l ->(*)) dr 


„d>(t) , 


(h) 


dy(Q 

dt 


+y (0 = i-o 


1.9 Obtain the process outputs >’(0.0), y(0.1), >(0.2), >(0.3), >(0.4) of the linear processes for 
the following respective process inputs. The available information is that the responses of 
the process to the process input Ui(t) = 1 for t > 0, u i( t) = 0 for t < 0 are >i(f) = 0.0 for 
t < 0.0, >!(0.1) = 0.01, >i(0.2) = 0.02, >j(0.3) = 0.04, and >,(0.4) = 0.07. 


(a) u(t) = 3.0 fort>0, u(t) = 0 fort<0 

(b) u(t) — - 2.0 for t > 0, u(t) = 0 fort<0 

(c) u(t) = 1.0 fort >0.2, u(t) = 3.0 for0<t<0.2, w(t) = 0 fort<0 

(d) u(t) = — 1.0 fort >0.2, u(t) = 0 fort<0.2 

(e) u(t) = — 1.0 fort >0.2, w(t) = 0 for0.1 < t<0.2, u(t) = 2.0 

for 0 < t < 0.1, u(t)= 0 for t < 0 
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1.10 Obtain the process outputs y(t) of the linear process for each of the following process 
inputs. The available information is that the responses of the process to the process input 
Mi(t) = sin(t) + sin(2f) + 1 are yi{t) = 0.7 sin(t — 0.1) + 0.5 sin(2f — 0.2) + 1.2 

(a) u(t) = 2 sin(t) 

(b) u(t) = 2sin(2t) 

(c) u(t) = - 2.0 

(d) u(t ) = 3 sin(f) + 2 sin(2t) 

(e) u(t) = 2sin(t)+2.0 

(f) u(f) =2 sin(? — 0.2) 

(g) u(t) =4.0sin(f-0.2) + 3.0sin(2t-0.1)+2.0 


1.11 Obtain the linearized process around u = 1.0 for the following nonlinear processes and 
express it with the deviation variables: 

(a) ^+y(t)(l+0.lM 2 (t)) = V«(0 


d f 
d y(t) 


v 3 {t) = u(t) 


*» ^+2^> + o . o $ m )=» ! m 


At 


1.12 Find y(t) for the following Laplace transforms: 
2 

~ (2s+l)s 
3 

” ,v(.v — 2) (.v — 2) 

1 

: ^sii 

i 

_ exp( - 0.5.?) 


(a) y(j) = - 

(b) y(s) = - 

(c) y(.s) = - 

(d) y(s) = - 

(e) y(s) = £ 


(f) y(s) = 

(g) y(» = 


( 5 + 1 )'s 

1 


exp( - 0.55) 

(s+l) 2 ,? (5+l) 3 ^ 


5 3 (j-2)(j + 2) 
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1.13 Find y{t) for the following differential equations using the Laplace transform: 

, . d 2 y(t) dy(t) t ^ ^ , dy(t)| 

(a) SF 


+ 3 ^+2y(t)=0, y(0) = 1, =0 

= 0 


m .rn 

d 2 y(t) , ,dy(t) 
d t 2 


+ 3^-+2y(t)= u (t), u(t)= 1.0 for 

d>’(0| 


t > 0.5, u(t) = 0.0 fort<0.5 andy(0) = - 


d 2 y(t) , „dy(t) 
dt 2 


+ 3 ^^+ 2 y(t) = w(f), u(t) = 1.0 for0.5 < t< 1.0, u(t) = 0.0 for 

Ml — n 


t<0.5orf > 1.0, andy(0) =- 


1.14 Find yi(t), yi(t) and y 3 (t) for the following differential equations using the Laplace 
transform: 


dyi(0 _ 


-y 3 (t) +1.0 


dyi(t) _ 


yi(t) — 3.0y 3 (t) — 0.5 


dy 3 (0 

dt 


=• y 2 (t) - 3.0y 3 (t) 


yi(o) = y 2 (o) = y 3 (o) =0 

1.15 Rewrite the following differential equations into the algebraic equations in the Laplace 
domain: 


(a) 

2 dy(0 

dt 

+y(t) = 

3.0(1- 

■y(4 

y(o) 

= 

0 



(b) 

2 dy(Q 

dt 

+y(t) = 

3.0(1- 

-y«) + 

“I 

V 

-y(r)) dr. 

y(o) = 

= 0 

(c) 

2 d y(0 

dt 

+y(t) = 

3.0(1- 

y(0) + 

,o i: 

(1 

— .v(t)) dr —i 

3.5^ 

^ M0, 

(d) 

d 2 y(t) 

dt 2 

+2 m 

dt 

+y(0 = 

= 3.0(1- 


dyW 

dt |^ 0 

y(o) = 

= 0 

(e) 

2 dy(t) 

dt 

+y(0 = 

3.0(S(t 

-0.5)- 

-y(t- 

-0 

.5)5(t —0.5)) 

, y(0 = 

= 0 for f < 0 
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(0 2 d ^° +?(/) = l.o |';.V(T-0.5)-><T-0.5)]dT T ().5 d:5(/ °- 5) tI; y{ ‘ °- 5): . 
y(t) = 0 for t < 0 

(g) +y(0 = «(f-0.5)S(t-0.5), «(0= -y(t) + 3.0(1 -y(0)> y(G)=0 

1.16 Rewrite the following algebraic equations into the differential equations in the time 
domain: 


(a) s 3 y(s) + s^y(s) + sy(s) = su(s) + 10«(j) 

(b) s 3 y(s) + s 2 y(s) + sy(s) = ( su(s ) + l()«(.v))cxp( - 0.1s) 


(c) 

(d) 

(e) 

(f) 


u(s) = - exp( - 0.1s)y(s) + (J -y(j))exp(-0.U')4/|j(‘} -y(s))exp(-0.1j) 
;+>v( J ( — y(j))exp( — O.Ij) 

, * _ ( —0.1 j 2 +0.55+ l)exp( — 0.1s) 

^ ~~ s 3 + 3s 2 +s+l U ^ 


, , exp(-O.ls) , . 
y(s) = 5 u(s) + 7 v(j) 


exp( — 0.2s) 


m 


1.17 Obtain the transfer function for the following process: 

W ^ + ^=-o.^ + 3»„-o,), ^M-o. 

u(t) = 0 for t < 0 

( b , 2^ + “f=O,„(0 + O. 1 j /W <., + O,^. %^m=o, 

u(t) =0 for t < 0 

u(t) = 0 for t < 0 

«0 2 d ^) + M.°,„ ( ,_o,, + H ,-0,,, 

u(t) =0 for t < 0, v(f) =0 for t < 0 


= y(P) = 0, 


1.18 Obtain the state-space process corresponding to the following processes: 

(a) 2^^ + 3y(t) = u(t — 0.5), j(0) = 0, u(t) = 0 for?<0 

(b) y + s m + ^^> + ^, my 

u(t)= 0 for t < 0 


J(0) = 0, 
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d t 2 

6 m, 

d t 

-3y(t) = 2u(t 

-0.5), 

dy(Q| 

dr 

= y(o) = o, 

(=0 

= o 

for r < 0 





d r 4 

„d 3 y(t) 


6^- 
d t 

■f 4y(r) 


+ 4 u(t), 






d 3 y(0 

d* 3 L=o 

d 2 y(t) 

d t 2 

_ dy(Q| 
Lo dr , = 

= y{ o) 

0 

= 0, 

^L- (o) =° 

2 + 

-8 

+ 12^ + 

6^1- 

f 4 y{t) 

= -0.2 d2 “<'-°- 3 > 

dr 4 

d r 3 

dr 2 

d t 

dr 2 


-03) + 
d t 

4w(r — 0.3), 




d 3 y(Q| 

= 0.3, 

d 2 y(0| 

-0.2, 

dy(0 

= 0.5, y(0) = —0.5, 

0 

d? 3 L=o 


d ' 2 Lo 


dr f= 

d»(Q| 

d t | <= _, 

= 0.2, 
).3 

wC-0.3) = 

-0.4 
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Simulations 


2.1 Simulating Processes Composed of Differential Equations 

In this section, the numerical derivative will be briefly introduced, followed by a simple method 
to solve first-order and high-order differential equations. 


2.1.1 Numerical Derivative and Solving First-Order Differential Equations 

Consider the following derivative definition: 


dy(0 

dr 


Um [ ypo + AQ-ypo) ) _ 

o\ to + At-to J 


m J' y(t 0 + At)-y(t 0 ) ] 
-°l At I 


( 2 . 1 ) 


It should be noted that the derivative can be approximated by choosing a small At instead of 
At —> 0 as shown below. 


dy(t) | _ y(t 0 + At)-y(t 0 ) 
dt \ t=to At { ' ’ 

where At is a small value. Equation (2.2) is called a numerical derivative. 

The MATLAB program in Table 2.1 is used to calculate the numerical derivative of 
y(t) = f 2 + 3f+latf=l and compares it with the analytical value. As expected, the 
numerical derivative value (5.000 009 999 989) is very close to the analytical derivative value 
(5.000000000000). 

If the At value is decreased further, then the accuracy of the numerical derivative will be 
improved. But, there is a practical limitation in improving the accuracy because the round-off 
error increases as At decreases. 

The same principle can be applied to solve differential equations. Consider the following 
differential equation: 

d ^)=-y W + f , y(0) = 1 (2.3) 


Process Identification and PID Control Su Whan Sung, Jietae Lee, and In-Beum Lee 
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Table 2.1 MATLAB code for the numerical derivative. 


numerical_derivative.m 

f .m 

command window 

tO=l,0; 

function [y]=f(t) 

» numerical_derivative 

delta_t=0.00001; 

y=t A 2+3*t+l; 

Nume Wda l_de riva ti ve = 


end 

5.00000999998917 

y0=f (t0>; 

y_delta=f (tO+delta_fc'li: 
dy_dt= (y_delta-y0)/ 
delta_t; 


Analytical^solution = 5 

Xur.e r i ca :_de r ivaLi vc = 
dy_dt 

Analytical_solution = 
(2*t0+3) 




The derivative dy(t)/dt can be approximated as follows: 

d y(t) _ y(t+At)-y{t) 
dt At 

Then, (2.3) can be rewritten as follows: 

y(f + At)-y(f) 


(2.4) 


= -y(t) + t 
y(t + At) =y(t) + (-y(t) + t)Af 


(2.5) 

(2.6) 

Now, y(t), t = At, 2At, ..., can be obtained for the given initial value v(0) by repeating (2.6). 
For example: 

f = 0 and y(0) = 1 — >y{At) = y(0) + (— y(0) + 0)At (2.7) 

t = At ^ y(2A t) = y{At) + (- y(At) + At) At (2.8) 

t = 2At ^ y(3At) = y(2A t) + (- y(2At) + 2At)At (2.9) 

t = 3 At —»y(4At) = y(3At) + (— y(3At) + 3At)At (2.10) 

It is straightforward to apply the same method to the more general case of dy(t)ldt = 
g(y(t), t ). For example: 

y(t + At) =y(t) + g(y(t),t)At (2.11) 


t = 0, y(0) = y 0 -> y(At) = y(0) + g(y(0), 0)At 


( 2 . 12 ) 


t = At—>y(2At) = y(At) + g(y(At ), At) At 


(2.13) 
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t = 2At^y(3A t) = y(2At) + g(y(2At),2At)At (2.14) 

t = 3Al —>;y(4Al) = y(3At) + g(y(3At), 3At)At (2-15) 

The above-mentioned method to solve differential equations (2.3) is called the Euler 
method. The MATLAB code in Table 2.2 is used to calculate y(t), 1 = 0.01, 0.02, 0.03, ..., 
for the given initial value >’(0) = 1; the simulation results are given in Figure 2.1. 


Table 2.2 MATLAB code to solve the first-order differential equation using the Euler method. 


eulerl.m 

gl.nt 

clear; 

function [dy_dt]=gl(y,t) 

t=0.0; 

dy_dt=-y+t; 

y=l.0; 

t_final=10.0; 
delta_t=0.01 ; 
n=round (t_final/delta_t) ; 
tor i=l: n 

t-_a r ray (.1) -L; 
y_array(i)=y; 
dy_dt=gl(y,t); 

y=y+dy_dt*delta_t; %Eq. (2.11) 
t=t+delta_t; 
end 

figure (1) ; 

end 

plot(L_array,y_array); 

command window 

» eulerl 



Figure 2.1 Simulation result of Table 2.2. 
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2.1.2 Solving High-Order Differential Equations 


The state-space representation (1.175)—(1.183) should be used to solve a high-order differential 
equation. For example, consider the following high-order differential equation: 


d 3 y(t) d 2 y(t) d y(t) d 2 u(t) du(t) 

dt 3 dt 2 dt dt 2 dt 


(2.16) 


u(t) = 1 for t > 0 


(2.17) 


d 2 y(t) 

dt 2 


d y{t) 

dt t =o 


= y(o) = o, 


du(t)\ 


= «( 0 ) = 0 


(2.18) 


To solve the differential equations (2.16)—(2.18), they should be rewritten in the correspo¬ 
nding state-space representation (2.19)-(2.24) according to (1.175)—(1.183): 


d x(t) 

dt 


= Ax(t) +Bu(t) 


(2.19) 


M = c *w 


( 2 . 20 ) 


*( 0 ) = [0 0 0 ]' 


0 0-1 
1 0 -3 

0 1 -3 


«=[' -5 l] 1 


( 2 . 21 ) 
( 2 . 22 ) 
(2.23) 

C = [0 0 1] (2.24) 

Now, it is straightforward to solve the high-order differential equation by repeating the 
equation 

x(t + At) = x(t) + (Ax(t) +Bu(t))At ( 2 - 25 ) 

The MATLAB code in Table 2.3 is used to calculate y(t), t = 0.01, 0.02, 0.03, ..., for 
(2.16)—(2.18) and the simulation results are given in Figure 2.2. 


Example 2.1 

Obtain the numerical derivative dy(t)/dt at t = 0.5 with At = 0.01 for the function 

y{t) = t exp( — 3t) (2.26) 


Solution 


d.y(z) _ y(0.5 + 0.01)-y(0.5) 
dt t=0 5 ~ OOl 


(2.27) 



Table 2.3 MATLAB code to solve the high-order differential equation using the Euler method. 


euler2.m. 

g2.m 

clear; 

function [dx_dt]=g2(y,x,u) 

t=0.0; 

A= [0 0 -1; 1 0 -3; 0 1 -3] ; 

x=[0 00]'; 

B=[l -5 1]'; 

Y=0; 

dx_d t=A * x+B 

is [0 0 1]; 

end 

t_finai*ii0.0; 


delta_t=0. oii' 


n=round (fe_fiaal/delta_t) ; 


f of ±*1 : n 


t_array(i)=t; 


y_array(i)=y; 


u=l.0; 


dx_dt=g2(y,x,u); 


x=x+dx_dt*delta_t; %Eq. (2.25) 


y=C*x; 


t=t+delta_t; 


end 

command window 

figure (1) ; 

» euler2 

plot(t_array,y_array); 




Figure 2.2 Simulation result of Table 2.3. 


Example 2.2 

Obtain the numerical derivatives dy(x,z)/dx, d 2 y(x, z)/dx 2 and d 2 y(x, z)/dxdz at x = 0.5 and 
z = 0.3 with Ax = 0.01 and Az = 0.005 for the function 

y(x, z) = x exp(— 3z) + x 2 + 2z (2.28) 
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Solution 


rj y(0.5 + 0.01,0.3)-y(0.5,0.3) 

9x lx—0.5,z—0.3 0.01 

»(*,*) ! y(0.5 +0.02,0.3)-y(0.5 +0.01,0.3) 

9x lx=0.5 +0.01,2=0.3 O'O' 

3 2 y(x,z)| ^ ^ y ( x , z)/3.\‘| v 0 .5:.0.01.2- 0.3 — 9 >’( x : z )/ 9 x l.y. 0.5.x 0.3 

^ x- 0.5..:—0.3 ” 0^1 

y(0.5 + 0.02,0.3) - y(0.5 + 0.01,0.3) _ y(0.5 + 0.01,0.3) - y(0.5,0.3) 


0.01 _ 

0.01 


0.01 


2.0000 

(2.31) 


9 2 y(3C,z)| _3/3y(x,z)\| ^‘M x > z )/ 9 z|x= 0 .5+ 0 . 01 ,z= 0 .3 <M x > z )/ 9z lx=0.5,z=0.3 

9x9z 1=0.5,2=03 _9x V 9z / 1=0.5,z=0.3~ °' 01 

y(0.5+0.01,0.3+0.005)—y(0.5+0.01,0.3) y(0.5,0.3+0.005)-y(0.5,0.3) 

_ _ 0.005 _ 0.005 ___1 9106 


(2.32) 


Example 2.3 

Simulate the following first-order differential equation using the Euler method with At = 0.01: 

^ = -y(/)+ «(*), y(0) = 1 (2.33) 

r> 2 2 5 5 (2.34) 

Solution The MATLAB code in Table 2.4 is used to simulate the process in (2.33) and (2.34) 
and the simulation results are given in Figure 2.3. 

2.2 Simulating Processes Including Time Delay 

The historical data of a signal need to be stored to simulate the delayed signal. Consider the 
array variable h_u{ 1 x m vector) that stores the historical data of u(t) in the following form: 


h_u( 1) . h_u{m — 2>) h_u(m — 2) h_u{m— 1) h_u(m) 

u(t-(m-\ )At) . u(t — 3At) u(t - 2At) u(t-At) u(t) 


where At is the sampling time. h_u(m) should be the present value of u(t) and h_u(m — 1) 
should be the delayed u(t) by as much as one sampling time. That is, when a new present value 
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Table 2.4 MATLAB code to simulate Example 2.3. 


euler_ex3.m 

g_ex3.m 

clear; 

function [dy_dt]=g_ex3(y,u) 

t=0.0; 

dy_dt=-y+f> 

y=l.0; 

t_final=10.0; 

delta_t=0. 01 i 

n=round (t_final/delta_t) ; 

for i=l: n 

t_array(i)=t; 
y_array(i)=y; 

if (t<2. 5) u=0; else u=l; end%Eq. (2.34) 
dy_dt=g_ex3(y,u); 
y=y+dy_dt*delta_t; %Eq. (2.11) 
t=t+delba_l;.f 
end 

figure (1) ; 

end 

plot(t_array,y_array); 

command window 
» euler_ex3 



Figure 2.3 Simulation result of Example 2.3. 

comes in, h_u(j),j= 1,2,..., m — 1 , should be replaced by h_u(j + 1 ),j= 1,2,.. .,m — 1 , and 
h_u(m) should be replaced by the new value. 

Now, assume that the time delay is 9, then nO = round(0/At) is the number of the sampling 
time corresponding to 6. Where, round(x) rounds x off to the nearest integer. Then, h_u 
(m — nO) corresponds to the delayed signal u(t — 0). 

For example, let us obtain u(t — 1) for the signal 

40-1 exp( i).. t> 0 (2.35) 


w(0 = 0, t<0 


(2.36) 
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Table 2.5 MATLAB code to simulate the pure time delay. 



The MATLAB code in Table 2.5 simulates the time delay and Figure 2.4 gives the simulation 



Figure 2.4 Simulation result of the pure time delay. 


For the other example, consider the following high-order differential equation with time 
delay. This is the same as (2.16)—(2.18) except for the time delay. 
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(2.37) 


u(t) = 1 forf>0, u{t) = 0 fort<0 


(2.38) 


d 2 y(t)| _dy(t)| 

dt 2 I <s=0: dt 1,^.0 


y(0) = 0, 


dwWI 


u( 0) = 0 


(2.39) 


The MATLAB code in Table 2.6 simulates (2.37)-(2.39) and Figure 2.5 gives the simulation 
result. 


Example 2.4 

Simulate the following first-order differential equation using the Euler method with At = 0.01: 


dy(0 

At 


-y{t) + u{t- 0.5), 


y(o) = i 


(2.40) 


u(t)= 1 for t > 2.5, u(t)= 0 forO < t<2.5, u(t) = 1 fort<0 (2.41) 


Solution In this example, the historical data h_u(J) = 1,7 = 1,2,..., 1000, should be initially 
filled with 1, because u(t)= 1 for f<0. The MATLAB code to simulate the process 
(2.40)-(2.41) and the simulation results are given in Table 2.7 and Figure 2.6 respectively. 


Example 2.5 

Simulate the following second-order differential equation using the Euler method with 
A? = 0.01: 


2 ^ + ,m +y{l)= _ h5 ^_M +2M ,_ 02) (2 . 42) 

u(t)= 1 fort >3, u(t) = 0.5 forO < t<3, u(t) = 0.3 fort<0 (2.43) 

=-0.1, y(0) = 0.8 (2.44) 


Solution In this example, the initial values are not zero. So, (1.184)-( 1.186) should be used to 
determine the initial state x(0). Then, the state-space realization is 



(t —0.2) 

(2.45) 

y(t) = [0 1 \x(t) 


(2.46) 

*(o) = x _1 <A 


(2.47) 
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4 ,= 


(2.48) 


! *-u 


(2.49) 


The historical data h_u(j) = 0.3 J =1,2,..., 1000, should be initially filled with 0.3, because 
u(t) = 03 for t< 0. The MATLAB code to simulate the process (2.42)-(2.44) and the 
simulation results are given in Table 2.8 and Figure 2.7 respectively. 


Table 2.8 MATLAB code 


date Example 2.5. 
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2.3 Simulating Closed-Loop Control Systems 

If the process input is a function of the process output then it is a closed-loop control system. For 
example, consider the following control system: 

2^= -y{t)+5u{t-m (2.50) 

u(t) — 0.3(y s (/) y(t)j (2.51) 

where (2.50) is the process of which the input is u(t) and output is y(t). Equation (2.51) is a 
controller which determines the process input on the basis of the process output y(t ) and the 
external signal y s (t). So, the system (2.50) and (2.51) is a closed-loop control system. Previous 
simulation techniques can be extended to the closed-loop control system in a straightforward 
manner. Consider the following examples. 


Example 2.6 

Simulate the following third-order differential equation 


d 3 y(Q 

dr 3 


0 d 2 y(t) , t dy(r) 
d f + dr 


+? 0 ) 


0.1 


d 2 w(r — 0.5) 
dp- 


using the Euler method with At = 0.01: 

_0 8 <M£_M +u(i _o 5 ) (252) 


u{t) = 1.2(1 -y{t)) fort>0, u(t) = 0 forr<0 (2.53) 


d 2 y(t) | _dy(r)| 

d? 2 1^ dr | 


y(0) = 0, 


d«(r) | 

dr | r= 


m(0) = 0 


(2.54) 


Solution In this example, the historical data h_u(j) = 0 ,j= 1,2,..., 1000, should be initially 
filled with 0 because u(t) = 0 for t < 0. The MATLAB code to simulate the process (2.52)-(2.54) 
and the simulation results are given in Table 2.9 and Figure 2.8 respectively. 
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Table 2.9 MATLAB code to simulate the closed-loop control system of Example 2.6 using 

the Euler method. 


euler_closed_exl.m 

g_closed_exl .na 

clear; 

funct i or. [dx_dt] =g_closed_exl (y,x,u) 

t=0.0 ; 

A=[0 0 -1; 1 0 -3; 0 1 -3] ; 

x=[0 0 0] 

B=[l -0.8 0.1]'; 

y=0; 

dx_dt=A*x+B*u; 

delta_t=0.01 ; 

end 

n=round (t_|inal/delta_t) ; 

cornmand window 

c= :o 0.1 ] ; 


theta=0. 5; %. delay 

» euler_closed_exl 

h_u=zeros(1,1000); 


n_theta=round(theta/delta_t) ; 


for JWl: n 


t_array(i) =t; 


y_array(i) =y; 


u=l. 2*(1.0-y); %Eq. (2.53) 


for j=l : 999 


h_u ( j ) «jyu ( j+1) ; 


h_u ( 10 0 0 ) =u ; 


dx_dt=g_closed_exl(y,x,h_u 


(1000-n_theta) ); 


x=x+dx_dt*delta_t; 


y=C*x; 


t*t^fde 1 La_t; 


end 


figure ( 1 ) ; 


plot(t_array,y_array) ; 


figure ( 2 ) ; 


plot ( u_ar ray,u_array) ; 


Example 2.7 


Simulate the following third-order differential equation using the Euler method with At = 0.01 : 

. ] d 2 y(t) Ay(t) 

, . n „du(t-0.2) . . . 

rT dfi~ +3 ~df~ +3 ~dT 

fy(t) = 0.3 ^ +u(t 0.2) (2.55) 

u(t) = l.5(y s (t)-y(t)) + l.5^l 

~ y ^ for t > 0, u(t) = 0 for t < 0 (2.56) 
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Figure 2.8 Simulation results in Example 2.6. 


Solution In this example, the historical data h_u(j ) = 0,j= 1,2, • • •, 1000 should be initially 
filled with zero because u(t) = 0 for f <0. The MATLAB code to simulate the process 
(2.55)—(2.58) and the simulation results are given in Table 2.10 and Figure 2.9 respectively. 
It uses the numerical derivative to implement d(v s (t) — y(t))/dt. 

2.4 Useful Numerical Analysis Methods 

In this section, simple numerical analysis methods required to design the controller and 
simulate the dynamics of the control system are introduced. 


2.4.1 Least-Squares Method 

The least-squares method has been widely used to fit data to a linear function model. It 
estimates the model parameters (2.60) by minimizing the objective function of Q(P). 
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Table 2.10 MATLAB code to simulate the close-loop control system of Example 2.7 using 
the Euler method. 


euler_closed_ex2.m 

clear; 
t=0.0; 
x= [0 0 0]'; 

y=0.0; yb=0.0; ys=0.0; ysb=0.0; 
t_final=15,0; 
delta_t=0.01; 
n=round (t_£inal /de 1 La_t) ; 

C=[0 01]; 

theta=0.2; % ti*j§ delay 
h_u=zeros(1,1000); 
n_theta=round(theta/delta_t); 
f or 1- : : r. 
t_array(i)=t; 
y_array(i)=y; 

if (t>l) ys=l. 0; else ys=0.0; end 
%Eq. (2.57) 

u=1.5*(ys-y)+1.5*((ys-y)- 
(ysb-yb))/delta_t; %Eq. (2.56) 
ysb=ys; yb=y; % one sampling 
before 

u_array (i|^p^' 
for j=l: 999 

h_u(j)=h_u(j +1); 

end 

h_u(10 0 0)=u; 

dx_dt=g_closed_ex2(y,x,h_u 
(1000-n_theta)); 
x=x+dx_dt*delta_t; 
y=C*x; 

del JCaJI | 

end 

figure (1) ; 

plot(t_array,y_array); 
figure (2) ; 

plot(t_array,u_array); 


g_closed_ex2 .m 

function [dx_dt]=g_closed_ex2(y, 
A= [0 0 -1; 1 0 -3; 0 1 -3] ; 

B= [ 1 -0.3 0.0]'; 
dx_dt=A*x+B*u; 
end 


command window 
» euler_closed_ex2 


57 — +P2 ( P2,i +p3<P3,i + • • • +Pn‘Pn,ii i~ 1,2,3,... ,m (2.60) 

where Pi, P 2 , P 3 , • • •, p„ are the model parameters. y t and <Pkj are the given data. 
Equations (2.59) and (2.60) can be rewritten as (2.61) and (2.62): 

mjn[£(P) = {Y-Y) t (Y- 7)] 

P 

Y = 0P 


(2.61) 

(2.62) 
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where the matrices and vectors of (2.61) and (2.62) are 



Y, Y, <P and P are an m x 1 vector, an m x 1 vector, an m x n matrix and an n x 1 
vector respectively. Note that the solution of the optimization problem (2.61) can be 
obtained by finding P that makes the gradient of Q(P) zero. So, consider the following 
gradient of Q(P ): 



(2.64) 
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where the definitions of the gradients in (2.64) are 

9Q(p) _ raj 

# L 


mp) 

mp) 

dC 

dp 1 

dpi 



dpi 

dh 

dpi 

dpi 

dp n 

dy 2 


dy 2 

dpi 

dpi 

Wn 

dy m 

dy m 

dy m 

dpi 

dpi 

dpn . 


dfn \ 


(2.65) 


(2.66) 


From (2.64), it is clear that the solution of the optimization problem (2.61) should 
satisfy (2.67). 

<P t (Y - <PP) = <P t Y - 0 T <PP = 0 (2.67) 


From (2.67), obtain the optimal solution: 

y'Y| (2.68) 

It is remarkable that the estimate (2.68) minimizes the sum of the squares’ errors (2.59). 
So, (2.68) is called the least-squares method. 


Example 2.8 

Obtain the model of which the structure is given in (2.69) to fit the ( x , y) data of (1.1, 3.1), 
(1.9, 5.1), (3.1, 6.9), (4.0, 9.2) in the sense of least squares. 

y=Pi+PiX (2.69) 


Solution From the data: 

Y 


Then, the least-squares method (2.68) results in the following estimates: 

P=[&$]- 1 [&Y\= j (2.7l| 

That is,/), = 0.9853 and p 2 = 2.0157. The estimated model output (2.62) for the given xand 
the estimated P is 


1 1.1 
1 1.9 

1 3.1 


(2.70) 


'3.2026' 

4.8152 

7.2340 

9.0482 


Y = 0P = 


(2.72) 
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Example 2.9 

Obtain the model parameters of t and £ in 

T 4 |G(ia; jt )| 2 V + {4r 2 e - 2r 2 )|G(i < a fc )| 2 ^ 2 = 1 - |G(i« fc )| 2 , w k = 0 . 1 *, k = 1,2, 3 , . .., 10 

(2.73) 

G(j) = faj 1 , (2.74) 

(.+ 1) 3 

Solution Let us define^! = t 4 , = |G ! (io>*)| 2 ct>^,^ 2 — 4x 2 ^ 2 — 2x 2 , <p 2 ,* = |G(icot)| 2 <n| 

and y* =1 — IG(i<w /c )l 2 . Then, r = p/ 4 and £ = ^/(p 2 +2 t 2 )/(4t 2 ). The source code for the 
least-squares method is shown in Table 2.11. The estimates are r= 1.424 and £= 0.917. The 
model output and the real data are compared in Figure 2.10. This is one of the model reduction 
methods, which will be discussed later in this book. 


Table 2.11 MATLAB code to solve Example 2.9 using the least-squares method. 


Is_ex2 .'fir. ' 

g_ls_ex2.m 

clear; 

ftinctfrSjft [G] =g_ls_ex2 (w) 

w(k)=k*0.1; 

G (k) -g_ls_ex2 (w(k) ) ; 
y (k, 1) =1- (abs (G (k) ) A 2) ; 
phi_l (k, 1) = (abs (G (k)) A 2) *w (k)^f|? 
phi_2(k,l)=(abs(G(k)) A 2)*w(k) A 2; 

PHI= [phi_l phi_2 ] ; 

Y=y; 

P_hat^fv (PHl'*PHI) 

tau=P_hat(1) A (1.0/4.0); 

xi=( (P_hat (2) +2*tau A 2!f / (4*ta'd A 2)) 

G=1/(s+1) A 3; 

Y_hat=PHI* P_hat; 


fprinijfN-' P_hat = %5.3f %5. j$' 

\n 1 ,P_hat(1),P_hat(2)); 


fptintf = %5 .' rki. = %5.- 

\n', tau, xi); 
figure (1 ):| 

plot (1:10, Y, 1 flU Y_hat) ; 
legend ('real data', 'model output') ; 

command window 

» ls_ex2 

P_hat = 4.116 2.764 
tau = 1.424 xi = 0.917 


2.4.2 Root-Finding Methods 

A root-finding method finds the x value that satisfies fix) = 0. This section introduces the 
bisection method, followed by the Newton-Raphson method. 
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The bisection method finds the root by reducing the interval (in which the root exists) by 
half at each iteration. Consider Figure 2.11 to understand the principle of the bisection 
method. It is assumed that the initial interval is chosen to include the root. Let the left-hand- 
side value of the interval be x L and the right-hand-side value of the interval be x R and the 
interval is x R — x L - In the first iteration, the bisection method divides the initial interval by 2 
and calculates the middle point x M = (x R + x L )/2. If the sign of/(x R ) and the sign of/(x M ) are 
the same, then it reduces the interval to half by updating the right-hand-side value as x R = x M - 
If the sign of/(x R ) and the sign of/(x M ) are not the same, then it updates the left-hand-side 
value as x L = x M . In the second iteration, the bisection method repeats the same procedure 
with the new interval. It repeats the procedure and updates the interval until the interval 
becomes a sufficiently small value. 



Figure 2.11 Graphical representation of the bisection method. 
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Example 2.10 

Obtain the root of f(x) = exp(x) + 3x — 20 with the initial interval between x = — 1 and x = 5. 

Solution The source code for the bisection method and the estimated root (x = 2.520 74) are 
shown in Table 2.12. 

Table 2.12 MATLAB code for the bisection method in Example 2.10. 

bs_exl .ij[. 

g_bs_exl.m 

clear; 

iuhctidfi [f]=g_bs_exl(x) 

x_L = -1; 

f = exp (x)+3*x-20.0; 

x_R = 5 ; 

end 

while (1) 


x_M=(x_L+x_R)/2.0; 

command window 

f_M=g_bs_exl(x_M); 


f_R=g_bs_exl(x_R) ; 

» bs_exl 

■ if(f_M*f_R> 0) 

x = 2.52074 f = 0.00000 

x_R=x_M; 

x_L=x_M; 

end 

tabs(x_R-x_L)<0.000000001) 
break; end 

end 

fprintf ('x =*%?(■. 5f f = %7.5f\n', x_L, 
f_R) ; 



The Newton-Raphson method finds the root of/(x) = 0 by approximating the given function 
with a linear function and calculating the root of the linear function in a repetitive manner. Let 
us approximate the given nonlinear function/(x) with the first-order Taylor series expansion at 
the Mi iteration (x = x/ c ) as below: 

/(x) w/(x/t) + £| (x-x k ) (2.75) 


Then, the approximated root (x = X/ c + i) of the next iteration can be obtained by setting 
J{x) = 0 in (2.75) as shown in (2.76): 


Xk+ 1 =X k ~ 


/(**) 

d/'/dvi. 


(2.76) 


The Newton-Raphson method finds the root by repeating (2.76) until the distance between 
Xjt+i and X/ c or the absolute value of/(Xjt+i) becomes a sufficiently small value. 

As mentioned above, the Newton-Raphson method uses the approximated linear function to 
calculate the next approximated root. It should be noted that the approximation using the linear 
function results in serious linearization errors if the original function of/(x) is highly nonlinear. 
Then, the performance of the Newton-Raphson method will be degraded significantly, 
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resulting in a poor convergence rate or divergence. To incorporate such a case, the following 
modification can be used: 


= x ,_ iM _ 

df/dx\ x=Xk +P 


(2.77) 


If [f(^new)| < \f( x k)\, set/3 = /3/1.5. x k +1 = x new and perform the next iteration (2.78) 


If |/(x ne w)| > [f(xk)\- set ft = 1.5)3, jcfc + i = Xk (no update) and perform the next iteration 

(2.79) 

where the initial /3 value is a small positive value. l/(x/ c )l denotes the absolute value off(x k ).This 
rule of thumb updates x only if the function value decreases; that is, |/(x new )l < l/fx/jl. 

The above-mentioned derivations can be extended to multivariable and multifunction 
systems. Consider the following root-finding system: 


/t(xi,x 2 ,---,x„) = 0 
/2(xi,x 2 ,---,x„) = 0 

/«(X1,X 2 ,---,X„) =0 


(2.80) 


Let us introduce the following vector representation to describe (2.80) more simply. 


F(X) = 0 (2.81) 

where X=[xi x 2 ••• x n ] T and F = |/i f 2 ••• f„ ]'. Equation (2.81) can be linear¬ 
ized by the first-order Taylor series expansion as follows: 


F(X) « F(Xfc) + VF\ x=Xk (X - X k ) (2.82) 

where VF is the gradient of the nonlinear function (2.80) or (2.81). 



m 

9/r 

dxi 

3x 2 

’ 3x„ 


9/2 

9/2 

3xi 

3x 2 

3x„ 


'9/, 

dfn 

.3xi 

3x 2 

3x„. 


Now, the approximated roots of the next iteration (2.84) can be obtained by setting F(X) = 0 
in (2.82). 

X*., X,-. (VF| x=Xt ) - J F(X fc ) (2.84) 


The Newton-Raphson method for the multivariable and multifunction system repeats (2.84) 
until the norm of Xyt + j — X^ or the norm of F(X/J becomes a sufficiently small value. This 
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method also shows a poor convergence rate or divergence for a highly nonlinear function 
system. To incorporate the case, the following modification can be used: 

Xnew = X, - (VF| x=Xt +/3I) - ^(X*) (2.85) 

If ||F(X new ) 11 < ||F(X*)||, set 13 = 13/1.5 , X t+1 = X new and perform the next iteration (2.86) 

If ||F(X new )11 > ||F(Xjt)||, set/3 = 1.5/3, X*+i = X* (no update) and perform the next iteration 

(2.87) 

where the initial /3 value is a small positive value and I is the n x n unit matrix. 11F (X k ) \ | denotes 
the Euclidean norm of F(X*). This rule of thumb updates X only if the function value decreases 
(that is, 11F(X new )11 < j|F(Xfr)||). 

Example 2.11 

Obtain the root of J{x) = exp(x) + 3x — 20 with the initial value of x 0 = — 1.0. 

Solution The source code for the Newton-Raphson method and the estimated root (x = 2.520 
74) are shown in Table 2.13. 


Table 2.13 MATLAB code for the Newton-Raphson method in Example 2.11. 


nr-exl.m 

3-n--ex'i$ 

clear; 

function [f]=g_nr_exl(x) 

x = -1; 

f = exp(x)+3*x-20.0; 

beta = 0.001; 

end 



.1 = g_nr_exl (x) ; 

deri_nr_exl.m 

df = deri_nr_exl(x) ; 


x_new = x-f/ (df +beta) ; 

function [df]=deri_nr_exl(x) 

f_new = g_nr_exl(x_new); 

df = exp(x)+3; 

if(abs(f_new) < abs(f)) 

end 

beta = beta/1.5; 



command window 

else 


beta = betatl‘.<Sj£ 

» nr_exl 

end 

x = 2.52074 f = 0.00000 

if(abs(f_new)<0,000000001) break; end 


end 


fprintf (] ]>'x = %7.5f f = %7.5f 


\n',x,f_new); 



Example 2.12 

Obtain the roots of fi{x\,X2) = xj + X2 + exp(2x2) — 2 = 0 and fi(xi,X2) = 
x\x\ + exp(xi — 1) — 1 =0 with the initial values of Xi i0 = 0.5 and x 2 ,o = 0-5. 

Solution The source code for the Newton-Raphson method and the estimated roots {x\ = 1.0 
and x 2 = 0.0) are shown in Table 2.14. 
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Table 2.14 MATLAB code for the Newton-Raphson method in Example 2.12. 


nr_ex2.tr 

g_nr_ex2 . m 

x = [0.5; 0.5] ; 
beta = 0.001; 
while (1) 

f = g_nr_ex2(x); 

df = deri_nr_ex2(x); 

x_new = x-inv (df +beta*eye (2,2) ) *f; 

:f_new = g_nr_ex2 (x_new) ; 

function [f] =g_nr_ex2(x) 
f(l,l) = 

x(l) A 2+x(2)+exp(2*x(2))-2; 
f (2,1) = 

x(l)*x(2) A 3+exp(x(l)-l)-l; 

deri_xir_ex2 .m 

Af (abs(f_new) < abs(f)J 

beta = beta/1.5; 


else 

beta = beta*l. 5; 

end 

Jif(abs(f_new)<0.000001) break; end 

fprintf ('x (tf-« f 1.5f x (2) = %7.,5f 
\n' , x (1) , x (2) ) ; 

fprinSE('f (1) - 17.51 f (2) - %7.5p 

function [df]=deri_ht_ex2(x) 
df (1,1) = 2*x|# S ; 
df (1,2) = l#*t*exp(2*x(2) ) ; 
df(2,1) = x (2) A 3+exp(x(1)-1); 
df(2,2) = 3*x(1)*x(2) A 2; 

command window 

\n',f_new(l) ,f (2) ) ; 

» nr_ex2 

x (1) = 1.00000 x(2) = 0.00000 
: (". ) =-C.CC0C0 : (2) = 0.00000 


Example 2.13 

Obtain the root of fix) = exp(x) + 3x — 20 with the initial value of x 0 = — 1.0. Use a numerical 
derivative to calculate the derivative in the Newton-Raphson method. 

Solution The source code for the Newton-Raphson method with the numerical derivative and 
the estimated root (x = 2.52074) are shown in Table 2.15. 

2.4.3 Numerical Integration 

The numerical integration method has been widely used to implement the process controller 
and simulate the dynamic behavior of the closed-loop control system. Two simple methods will 
be presented in this section. 

The simplest one is the Euler integration method, which is sufficient for most cases in the 
research area of the process control and identification. Consider the differential equation 
ds{t)/dt = e(t). Then, sit) is the integral of eft). From the Euler approximation ds(t)/dt « 
(s(t + At) — s(t))/At, the numerical integration s(t + At) = s(t) + e(t)At is obtained. The 
integral with respect to t can be calculated by repeating sit + At) = s(t) + eit)At. 

On the other hand, the other Euler approximation dsit)/dt ss isit) — s{t — At))/At (that is, 
s(t) = s(t — At) + elf)At) is also possible. Then, the numerical integration sit + At) = s(t) + 
e(t + At)At is obtained. The trapezoidal integration method sit + At) = sit) + ieit + At) + 
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Table 2.15 MATLAB code for the Newton-Raphson method in Example 2.13. 

nr—ex34. 

g_nr_ex3.m 

clear; 

fuhefcion [f]=g_nr_ex3 ( x) 

x = -1; 

f = exp(x)+3*x-20.0; 

beta = 0.001; 
while (1) 

f = g_nr_ex3(x); 
df = deri_nr_ex3(x); 
x_new = x-f / (df +beta) ; 

end 

f_new = g_nr_ex3 (x_new) ; 

(abs (f_new) < absfffH; 

deri_hf_ex3.m 

beta = beta/1.5; 

[df ] =deri_nr_ex3 (x) 

x = x_new; 

f_delta = g_nr_ex3 (x+0.0001) ; 

else 

f = g_nr_ex3(x) ; 

beta = beta*l. 5; 

df = (f_delta - f)/0.0001; 

end 

if(abs(f_new) 

<0.000000001) break; end 

end 

fprintf (' x - % 7.5f f = %7.5f 

command window 

\n',x,f_new) ; 

» nr_ex3 

x = 2.52074 f = 0.00000 


e(t))At/2 is obtained by averaging the two Euler approximations s(t + At) = s(t) + e(t)At and 
s(t + At) = s(t) + e(t + At)At. The trapezoidal method is usually superior to the Euler 
method. But, the difference of the performances is negligible for most cases if a sufficiently 
small At is used. 

Example 2.14 

Obtain the numerical integration of f(x) = exp(x) + 3x — 20 from x = 0 to x = 1 using the 
Euler method and the trapezoidal method. 

Solution The source code for the Euler method and the trapezoidal method and the results are 
shown in Table 2.16. The analytical value is —16.78172. 

Example 2.15 

Obtain s(t) = s( 0) + Jq e(r) dr for e(t) = t exp(— t) and ,s(0) =1.5 using the Euler method. 

Solution The source code for the Euler method and the results are shown in Table 2.17. and 
Figure 2.12 respevtively. 

2.4.4 Optimization Methods 

Simple optimization methods, such as the interval halving method and the Levenberg- 
Marquardt method, have been used in the research area of process identification. The interval 
halving method for a single-variable optimization is introduced in this section, followed by the 
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Table 2.16 MATLAB code for the numerical integration method in Example 2.14. 


ni_exl. St.. 

g_ni_exl.m 

dear; 

function [f]=g_ni_exl(x) 

se = 0-0; 

exp (x) +3*x-20.0; 

Stafl.O; 

end 

x = 0.0; 


n = 1000; 


delta_x= (1.0-0.0)/n; 


for i = 1: n 


ijl:.- g_ni_exl (x) ; 


se = seSpil*delta_x; 

command window 

x = x + delta_x; 


f2= g_ni_exl(x); 

» ni_exl 

st = st + (f 1 + f 2) 

Euler = -16.78408 

*delta_x/2; 

Trapezoidal=-16.78172 

end 


fpriutf fluler = %7.5f 


\n', se); 


fprintf ('Trapezoidal = 


%7.5f\n',st) ; 



Table 2.17 MATLAB code for the numerical integration method in Example 2.15. 


ni_ex2.m 

g_ni_ex2.m 

clear; 

iuncttofe [f]=g_ni_ex2(t) 

se = 1.5;'^^fflihial value 

' i|!^:t*exp ('-.£)•; 

t = 0.0 ; 
n = 1000; 
tf = 5.0; 

delta_t = (rf - 0.0) fr.; 
for i = 1: n 


t_array(i)=t; 
se_array(i)=se; 

command window 

f = g_ni_ex2(t); 
se = sej*delta_t; 

+ delta_t; 

end 

figure (1) ; 

plot(t_array,se_array); 

» ni_ex2 


Levenberg-Marquardt method to solve multivariable optimization method. The optimization 
methods are to find the optimal solution that minimizes the objective function as mm j'ix). 

The interval halving method removes exactly half of the interval at each iteration. Consider 
the three cases /(xi) <fix 2 ) <f(x 3 ), f(x{) >J{x 2 ) > J{x 3 ) and/fx,) >/fx 2 ) and f{x 2 ) </(x 3 ) 
shown in Figure 2.13. x L , x h x 2 , x 3 and x R are equally spaced. The optimal solution may exist 
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Figure 2.12 The result of the numerical integration in Example 2.15. 
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Figure 2.13 Three cases for the location of the optimal solution. 


between x L and x 2 , x 2 and x R , x t and x 3 for each case off(x i) <f(x 2 ) <f(x 3 ),f(X]) >f(x 2 )> 
f(x 3 ),f(x\) >f(x 2 ) and/[x 2 ) </(x 3 ) respectively. So, the subintervals (x L , x,) and (x 3 ,x R ) can 
be removed for the third case. Similarly, the subintervals (x 2 , x R ) and (x L , x 2 ) can be eliminated 
for the first case and the second case respectively. Then, the procedure of the interval halving 
method will have the following three steps. Step 1, calculate Xj, x 2 and x 3 forgiven the interval 
(x L , x R ) and obtain/(x,),/(x 2 ) and/(x 3 ). Step 2, set x R = x 2 and x L = x 2 for the first case and the 
second case respectively. And, set x R = x 3 and x L = X| for the third case. Step 3, finish if the 
interval is sufficiently small. Otherwise, repeat the procedure from Step 1 to Step 3. 

Example 2.16 

Obtain the optimal solution for the following optimization problem with the initial interval 
from —5 to 3: 


min/(x) subject to/(x) = (x— l) 2 


( 2 . 88 ) 


Solution The source code for the interval halving method and the results are shown in 
Table 2.18. 
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Table 2.18 MATLAB code for the interval halving method in Example 2.16. 



Note that the gradient of the objective function is zero at the optimal solution. On the basis of 
this fact, the Levenberg-Marquardt method estimates the optimal solution by finding the roots 
that make the gradient of the objective function zero. 

VF(X) = 0 (2.89) 

where 
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Now the approximated roots of the next iteration in (2.92) can be obtained by setting 
VF(X) = 0 in (2.90). 

X* +1 = X* - (V 2 F| X=X J -1 VF(Xj.) (2.92) 

The optimal solution can be obtained by repeating (2.92) until the norm of X* + j — X k or the 
norm of VF(X fc ) becomes a sufficiently small value. But this approach would show a poor 
convergence rate or divergence for a highly nonlinear function system. To incorporate such a 
case, the following Levenberg-Marquardt method is introduced: 

x new = x, - (V 2 F| x=Xt +131) - 1 VF(X fc ) (2.93) 

If/(Xnew) </(Xfc), set/3 = P/1.5, X fc+ i = X new and perform the next iteration (2.94) 


If/(X new ) > f(X k ), set /3 = 1.5/3, X k+ 1 = X k (no update) and perform the next iteration 

(2.95) 

where the initial /3 value is a small positive value and I is the n x n unit matrix. It updates X only 
if the function value decreases (that is,/(X new )</(X k )). 

Example 2.17 

Obtain the optimal solution for the following optimization problem with the initial values 
X\ = 2.5, x 2 = 0.0 and x 3 = 0.0: 

min f(xi,x 2 ,Xi) subject tof(x) = (x\ - l) 4 (x 2 - 2) 2 + (x 3 - 3) 2 (2-96) 

Solution The source code for the Levenberg-Marquardt method and the results are shown in 
Table 2.19. 


Table 2.19 MATLAB code for the Levenberg-Marquardt method in Example 2.17. 


lm_exl.m 

g_lm_exl.m 

clear; 

x = [2*5; 0.0; 0.0]; 
beta = 0.001; 
while (1) 

f = g_lrfi_©xl (x) ; 
g = gracti_lm_exl (x) ; 
c - con j_Lrr._ex" (x) ; 

fuae : fe|.'b® [ f ] =g_lm_exl (x) 
f = (x (1) -1) A 4* (x (2) -2) A 2 + (x (3) - 
3) A 2; 

gradi_lm_exl.m 

x_new = x-inv(c+beta*eye(3,3))*g; 

f_new = g_lm_exl(x_new) ; 
if(abs(f_new) < abs(f)) 

function [g]=gradi_lm_exl(x) 

beta = beta/1.5; 

g = [4*(x(l)-1) A 3*(x(2)-2) A 2 

x = x_new; 

(x (1) -1) •'4*2* (x (21-2) 

else 

2* (x (3) -3) ] ; 

beta = beta*l.5; 

end 

end 
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Table 2.19 ( Continued ) 


if(abs (g) <0.00000001) break; end 

command window 

end 


fprintf ('x >,5f, x (2)=%7.5f, 

» lm_exl 

x(3)=%7.5f\n',x(l) ,x(2) ,x(3) ) ; 

x(l)=l.01560, x(2)=l.98952, 

= %1.5f\n' r 0; 

x(3)=3.00000 


f = 0.00000 


conj_lm_exl.m 


function [c]=conj_lm_exl(x) 

c= [12*(x(l) —1) A 2*(x(2)-2) A 2 8* (x (1)-1) A 3*(x(2) -2) 0 
8* (x(l)-l) A 3*(x(2)-2) (x(l)-l) A 4*2 0 
0 0 2 ]; 
end 


Problems 

2.1 Calculate the numerical derivative dy(t)/dt at t = 0.3 with At = 0.005 for the following 
functions using MATLAB code. 

(a) y(t) = t 2 exp( — 2t) + 

2.2 Calculate the numerical derivatives dy(u t , u 2 , u 3 )ldui, dy(u u u 2 , u 3 )/du 2 , dy{u\, u 2 , w 3 )/9m 3 , 
d 1 y(ui,u 2 ,u 3 )/du 2 l , d 2 y(ui,u 2 ,u 3 )/duidu 2 and d 2 y(ut,u 2 , m 3 )/9mi9m 3 at t/i = 0.5, w 2 = 1.0 
and w 3 = 0.0 with Am, = 0.01, Am 2 = 0.02 and Am 3 = 0.005 using MATLAB code. 

(a) y(m,u 2 , m 3 ) = «iM 2 + u 2 u 2 + u\u 2 u 3 

(b) y{u\,u 2 ,u 3 ) = exp( - u\u 2 ) + u\u 3 + \n(u\u 2 + m 3 ) 


2.3 Simulate the following process using the Euler method with At = 0.01: 


(a) ^T = -y(t) + (2 + 0.1y(t))u(t), y(0) = 0.5 



(b) -y^^ + P+o^M-oJ), y(0) = 0.5 



(c) 


d A y{i) / 3 y(t) d 2 y(t) 


+4 «o 

df 




«(<I 


1 - 1(1 


d 3 y(?) _ d 2 y(t| dy(Q 

dt 3 t=0 dfi t _ () dt t=Q 


= y( o) = o 
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i+4^+6^+4^+K<)=»(>),«(<) = 1.1(1 -m 

dt 4 dt 3 df 2 d? 


-^| V -*>>*• J ^i 


d 2 y(Q 

dt 2 


_ dv(i) 


= >i(0) = 0 


^ + 3-0^ +y(0 = 2w(i—0.5), «(0 = 0.7(1 ->1(0) + ^ jV-y(r))dr+1, 


= y(0) = 0, u(t)=0 for t <0 


+ ^I 0 ( 1_>, ( T )) dT+1 ’ ^d/ 1 =1'( 0 ) = 0 ’ M W = ° for 1 < 0 


+3-0°^ + y(f) = o. 3 ^-^ +2M(f _ a5)) 

«(0 = 0.7(y s (f )+ °^jW) -y(r)) dr + O.S®^^, 

V s (/) = ( 2 ? - 2-0 , ^ I = >1(0) = 0, u(t) = 0 for 1 < 0 

’ V ' \0 ?<2.0 d? |, =0 ^ J w 

^ +3.0^ + y( 0 = o.S^M + 2 m( 1-0.5), 

. 0.7 f'.„„ d(y,(0-y(Q) 

df 

= -0.5, y(0) = 0.2, u(t) = 0.5 for f < 0 


f 2 1 > 2.0 dy(Q I 

10 f<2.0 ’ d? L 


-+2.0^+y(f) = «(f-0.5), 


,V S (0 = 

d 2 y(Q 
dt 2 

u{t) = 1.5(y s (/) -y(f)) + dr+ 1.5 x 0.5 

= y (0) = 0, u(t) = 0 for ? < 0 

at | /=0 

, . f 1 t > 1.0 w , f - 1 

• Vs( ^ _ {0 /<1.0 • d ^ _ {o 


d(y,(Q-y(Q) 


+ d(0, 


t > 20.0 
?<20.0 
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2.4 Estimate the following model for the given data using the least-squares method: 
Model y = P x x + P 2 x 2 
Data 


x 1 2 3 4 5 

y 5 16 33 56 85 


2.5 Estimate the following model for the given data using the least-squares method: 
Model y = P\ exp(— x) + P 2 x 2 
Data 


x 1 2 3 4 5 

y 3.74 12.27 27.10 48.04 75.01 


2.6 Transform the following model to an appropriate form and estimate the model parameters 
using the least-squares method: 

Ei A' 3 

Model y = -. 

Pi+x 3 

Data 


x 1 2 3 4 5 

y 1.000 1.778 1.929 1.969 1.984 


2.7 Obtain the root of y(x) = x 3 — 5x 2 + 5x — 8 using the following methods: 

(a) bisection method with the initial interval between x = 3 and x = 5; 

(b) Newton-Raphson method using numerical derivative with the initial value x 0 = 5.0; 

(c) Newton-Raphson method using the analytic derivatives with the initial value x 0 = 5.0. 

2.8 Obtain the roots of the following equations using the Newton-Raphson method with the 
initial values Xi = 1.0 and x 2 = 1.0: 

/i ( v-| , x 2 ) = x 2 xf + exp( - xi)x 2 - 6.9829 

h{x i,x 2 ) = X! +xiX2+exp(-xi +2.0)(x 2 + 3) - 17.842 

(a) use the numerical derivatives; 

(b) use the analytic derivatives. 

2.9 Obtain the roots of the following equations using the Newton-Raphson method with the 
initial values xq = 1.0, x 2 = 2.0 and x 3 = 3.0: 

fi (xi, x 2 , x 3 ) = x\x\ + exp( - xi)x 2 + xix 3 - 9.3829 

f 2 (x i, x 2 , x 3 ) = x\ + xix| + exp( — x\ + 2.0) (x 2 + 3) + (x 3 — l) 2 — 18.842 

/ 3 (xI,x 2 ,x 3 ) = Xi +x 2 + x 3 -5.3000 
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2.10 Solve the following optimization problem using the interval halving method of which the 
initial interval is from 3 to 5: 


min (x 3 - 5x 2 + 5x - 8) 2 

2.11 Solve the following optimization problem using the Levenberg-Marquardt method with 
the initial values x\ = 0.9 and x 2 = 1.5: 

min{F(xi, x 2 ) = (x, - 1-0) 3 + (x 2 -2.0) 2 } 

2.12 Solve the following optimization problem using the Levenberg-Marquardt method with 
the initial values Pi = 0.9 and P 2 = L8. Use the numerical derivatives to obtain the 
Jacobian. 


Objective function : 




X\ = 1 x 2 = 2 x 3 = 3 x 4 = 4 x 5 = 5 

y, = 1.000 y 2 = 1.778 y 3 = 1.929 y 4 = 1-969 y 5 = 1.984 
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3 


Dynamic Behavior of Linear 
Processes 


3.1 Low-Order Plus Time-Delay Processes 

The first-order plus time-delay (FOPTD) model and the second-order plus time-delay 
(SOPTD) model have been widely used to design and implement process controllers. And 
the terms related to the low-order plus time-delay processes are very useful for describing the 
dynamic characteristics of the process or the closed-loop control system. In this section, the 
dynamic behaviors of the FOPTD and SOPTD processes for the step input are derived and 
the important terms are introduced. 

3.1.1 First-Order Plus Time-Delay Processes 

The FOPTD process is 

jg = texp(-to) 

W u(s) TJ+1 v ; 

where k, x and 6 are called the static gain, the time constant and the time delay respectively. The 
step input response (3.3) can be obtained by solving the differential equation (3.1) for the initial 
conditions (3.2): 

u(t) = d forf>0 and u(t) = 0 forf<0, y(t) = 0 for?<0 (3.2) 

y(t) = |l — exp^— -—for?>0, y(t) = 0 fort<0 (3.3) 


Process Identification and PID Control Su Whan Sung, Jietae Lee, and In-Beum Lee 
© 2009 John Wiley & Sons (Asia) Pte Ltd 
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As shown in Figure 3.1, the physical meaning of the time constant is how fast the process 
responds to the process input. The static gain represents how much the process output changes 
for the variation of the process input. The time delay is the time required for the process input to 
affect the process output for the first time. 

Example 3.1 

The process shows the step response of Figure 3.2 for the step input from 0 to 2 at t = 0. Obtain 
the FOPTD model. 



1.5 - 

f 1 . 

0.5 - 

0 I - 1 - 1 - 1 - 1 - 1 - 1 - 1 - 1 - 1 - 1 - 1 - 1 - 1 - 1 - 

0 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 

t 

Figure 3.2 Response of a FOPTD process for the step input test of Example 3.1. 


Solution The static gain is k = y(°°)/d = 6.0/2.0 = 3.0. The time delay is 6 = 1.0 directly from 
Figure 3.2. The time constant t = 2.0 is obtained by drawing the tangent line at t = 1.0 and 
reading the point at which the tangent line and the y(t) = 6.0 line intersect. The same result is 
obtained by reading the time at which the process output reaches 0.6321y(°°). So, the FOPTD 
model obtained is G(^) = 3.0exp(— 1.0 j)/(2.0j + 1). 

Note that this kind of process identification is only applicable to the FOPTD process. More 
general approaches will be introduced later. 
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3.1.2 Second-Order Plus Time-Delay Processes 

The SOPTD process is 


y(j) k exp (—6 s) 




u(s) z 2 s 2 + 2 t£s + 1 


(3.7) 


where k, z, £ and 6 are called the static gain, the time constant, the damping factor and the time 
delay respectively. The step input response can be obtained by solving the differential 
equation (3.7) for the initial conditions (3.8): 

u(t) = d fort>0 and u(t) = 0 fort<0, y(t) = 0 fort<0 (3.8) 

For £ > 1 (overdamped process) 

,(«) W-j- • nexp[-(«-8)/,,]-,,exp[-(«-8)/,j | [o[| ^ (3 9) 


y(t) = 0 for t<6 

For £ = 1 (critically damped process) 

y(t) = kd{ I — [1 — (/— 0)/r]exp[ - (t~6)/z}} 


y(t) = 0 for t<0 


(3.10) 

(3.11) 

(3.12) 


For £< 1 (underdamped process) 
y(t) =kd(\—ex\ 


:p[-^(t-0)/r]|cos ^ ^ ( t-0 ) +-^=L=sin ^ ^ (t-0) jj 


y(f)=0 for t<6 


(3.13) 

(3.14) 


T T 



Note that d 2 y(t)/dt 2 is affected directly by the process input. But dy(t)/dt is affected 
indirectly, because it is a result of the integral of d 2 y(t)/dt 2 . So, the first derivative dy(t)/dt 
has no discontinuity at t = 6. The second derivative has a discontinuity at t=6. 

As shown in Figure 3.3, there are the three types of step response for the SOPTD process. 
One is the overdamped process, which shows no oscillation and the roots of the denominator 
z 2 s 2 + 2z£s + 1=0 are distinct and real (equivalently, £ > 1). Another is the critically 
damped process, which shows no oscillation and the denominator z 2 s 2 + 2zgs +1 = 0 has 
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0.8 

§ 06 
0.4 
0.2 

0 

0 5 10 15 

Figure 3.3 Responses of a SOPTD process with respect to the damping factor. 




uH 



the real double root (equivalently, £ == 1). The other is the underdamped process, which shows 
oscillation and the roots of the denominator t 2 s 2 + 2xi;s + 1 = 0 are distinct and complex 
(equivalently, £< 1). 

In particular, consider the underdamped response in Figure 3.4. The following terms to 
characterize the underdamped response should be kept in mind, because they have been widely 
used to characterize the control performance of the closed-loop control system. 

tpi and t p2 are the first peak time and the second peak time. The settling time t s is the time 
required for the process output to reach within 5% of the final value. The overshoot and the 
decay ratio are defined as (y pi - and (y p2 - y(°°))/(y p i - y(°°)) respectively. 

Obtain the following equations from (3.13): 

t p = 6 + nx/= 6 + P/2 time to first peak 


(3.15) 
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Figure 3.4 Underdamped response. 

(3.16) 

(3.17) 

(3.18) 


P = . .. . period 


y P i - y(°° 


WT\ 


y P 2 -y(°° 

>' P i -}'( 00 


(y pi-y(°° 


~27lg 


Example 3.2 

Figure 3.5 shows the step response (top) for a process receiving a step input (bottom) from 0 to 1 
at t = 0. Obtain the SOPTD model. 

Solution The static gain is k = y{°°)/d= 1.0/1.0= 1.0. The time delay is 6= 1.0 directly 
from Figure 3.5. And the first peak is y p i = 1.37 and the period P = 9.8 from Figure 3.5. 
Then, i; = 0.3 and r = 1.5 are obtained from (y pi — y{°°))/y{°°) = exp[ — n^/( \ — £ 2 ) 0 ' 5 ] and 
P = 2j:t/(I -£ 2 )°‘ 5 . So, the SOPTD model obtained is G(s) = 1.0 exp(-l.O.v)/ 
(1.5 V + 2.0 x 1.5x0.35+ 1). 

3.2 Process Reaction Curve Method 

The process reaction curve (PRC) method is used to obtain the FOPTD model from the step 
input test. The procedure is as follows. First, a step input u„ enters until the process output 
reaches a steady state as shown in Figure 3.6. Note that most processes in industry show step 
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Figure 3.6 Typical step response of the usual open-loop stable and overdamped processes. 

model for the FOPTD process. However, it also suffers from several practical problems. The 
FOPTD model has limitations in approximating underdamped/high-order processes. Also, it is 
difficult to determine the inflection point if the measurements are contaminated by measure¬ 
ment noise. Moreover, the method requires a long identification time and the model obtained 
can be sensitive to disturbances and/or noises because it opens the control loop until the system 
reaches the steady state. 

Example 3.3 

Figure 3.7 shows the step response (top) for a process receiving a step input (bottom) from 0 to 1 
at at t = 0. Obtain the FOPTD model using the PRC method. 

Solution The static gain is k = y{°°)ld = 1.0/1.0 = 1.0. The time delay 6 = 1.0 and the time 
constant t = 4.0 are obtained by drawing the tangent line at the inflection point and reading the 
point at which the tangent line and the y{t) = 1.0 line intersect. So, the FOPTD model obtained 
is G{s)= 1.0exp(—1.0s)/(4.0s + 1). 

3.3 Poles and Zeroes 

Poles are finite s values that make the transfer function infinite. Zeroes are finite s values that 
make the transfer function zero. For example, the transfer function (1.162) has a pole of — 1 and 
a zero of —1/3. Roughly speaking, poles make the denominator of the transfer function zero and 
zeroes make the numerator of the transfer function zero. The dynamic characteristics can be 
understood by investigating the poles and the zeroes as follows. 

3.3.1 Relationship Between Poles and Dynamic Behaviors 

Consider the following examples to see how the dynamic characteristics are connected with 
poles. The results of the examples will be summarized to derive extremely important conclu¬ 
sions on the stability. 









Process Identification and PID Control 


As shown in Example 3.4, the process output y(t) diverges exponentially as t increases 
because it is a linear combination of the monotonically increasing exponential functions exp(t) 
and exp(2/), originated from the positive poles. 


Example 3.5 

The process has real negative poles. 

?(■?) _ 1 
u{s) (j+1)(j + 2) 


(3.21) 


The process (3.21) has poles of — 1 and —2. Equation (3.21) can be rewritten for the step input 
signal u(s) = Vs: 


y(s) = 


1 _ 1/2 

(j+1)(j + 2)j ^ 


1/2 


(3.22) 


As shown in Example 3.5, the process output y(t) converges exponentially to the steady-state 
value of 1/2 as t increases because it is a linear combination of the monotonically decreasing 
exponential functions exp(—/) and exp(— 2t), originated from the negative poles. 


Example 3.6 

The process has complex poles of which the real parts are negative. 
u(s) ' 


5 2 + 2j+2 [j-(- l + i)][s-(-1-i)] 


(3.23) 


The process (3.23) has complex poles of — 1 ± i. Equation (3.23) can be rewritten for the step 
input signal u(s) = Vs: 


m = 


4s-(-l + i)][,s-(-l-i)] ' 


(l~i)/2 
s—(—1+i) 


(l+i)/2 

s-(-l-i) 


(3.24) 


y(t) = 1- ^exp(-/ + i/)- ^exp(-/-it) 

™<-d (3 - 25) 

= 1- 2 “[(1 — i)exp(i/) + (1 +i)exp( — i/)] 

Equation (3.25) can be rewritten using the Euler formula exp(ix) = cos(x) + i sin(x): 

y(t) = 1 — exp( — f)(cos t+ sin t) (3.26) 

As shown in Example 3.6, the magnitude of the process output y(t) converges exponentially 
to the steady-state value of 1 as t increases because the magnitude is determined by the 
monotonically decreasing exponential function exp(— t), originated from the real part of the 
pole. Also, y(t) oscillates with a period of 2jr because of the two functions exp(if) and exp(— it), 
originated from the imaginary part of the pole. 
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Example 3.7 

The process has complex poles of which the real parts are positive. 

y(j) 2 _2_ 

u(s) 


;2 — 2s+ 2 [*-(l + i)l[*-(l-§i 


(3.27) 


The process (3.27) has complex poles of 1 ± i. Equation (3.27) can be rewritten for the step 
input signal u(s) = 1 Is: 


y{?) . 

u(s) 




,-(l+i) 


(l + i)/2 
5 ' — (1 — i) 


(3.28) 


y(0 = 1 “ -y-exp(H-if) - -^exp(t-it) = 1 - ^|^[(1 -i)exp(it) + (1 +i)exp(-it)] 

(3.29) 

Equation (3.29) can be rewritten using the Euler formula exp(ix) = cos(x) + i sin(x): 

y(t) = 1 - exp(?)(cos t + sin t) (3.30) 

As shown in Example 3.7, the magnitude of the process output y(t) diverges exponentially as 
t increases because the magnitude is determined by the monotonically increasing exponential 
function exp(t), originated from the real part of the pole. Also, y(t) oscillates with a period of 2jt 
because of the two functions exp(it) and exp(—it), originated from the imaginary part of 
the pole. 


Example 3.8 

Consider the following strictly proper system in which the poles are different from each other. 
Strictly proper means that the order of the numerator is less than that of the denominator. 


r( x. g(s - Z^js - z 2 ) ■ ■ ■ (s - z m ) 

U ( s -p l )(s-p 2 )---(s-p n ) ’ 


n>m 


(3.31) 


where Pk and z k are the poles and zeroes of the system and a is an arbitrary constant. The poles 
and the zeroes are real or complex numbers. Equation (3.31) for a step input can be rewritten 
equivalently by partial fractions as follows: 




Ai 

*-Pi 


^4-2 

s-p-1 


A n 

S~Pn 


(3.32) 


Then, y(t) = A 0 + A , exp(pit) + A 2 exp(p 2 t) + • • • + A„exp(/j n t) is obtained. That is, y(t) 
is a linear combination of exp (pkt), k=l,2,...,n, originated from the poles. By the Euler 
formula: 


exp (pkt) = exp(Re(/)*)t + i \va(p k )t) = exp(Re(p*)t)[cos(Im(/7/)t) + i sin(Im(/j fe )f)] 

R e(pk) and Im (p k ) are the real part and the imaginary part respectively. Note that exp(Re- 
(Pk)t) determines the magnitude. So, if one pole has a positive real part, then the system is 
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unstable. If all the poles have negative real parts then all the terms are exponentially 
converging functions, so that the system is stable for a step input. 

The same conclusion can be reached for the case that some of the poles are the same, like 
double root, triple root and so on. If the process is rewritten with partial fractions for the case 
that it has a double root of pk, then it will contain t exp (p k t) additionally. So, the stability is still 
determined by the real part of the pole. 

Also, the system is unstable for a step input if one of the poles is located on zero because the 
partial fraction form of y(s) contains 1 Is 2 , which is an unstable ramp function. 

In summary, the following statements can be concluded by generalizing the results of 
Examples 3.4-3.8. 

1. If all the poles are real, then the process output will not oscillate for a step input signal. 

2. If one of the poles is complex, then the process output will oscillate for a step input signal. 

3. If one of the poles has a positive real part the process output will diverge (unstable) for a step 
input signal. 

4. If the poles have negative real parts the process output will not diverge (stable) for a step 
input signal. 

5. If one of the poles is located on zero, the process output will diverge for a step input signal. 

3.3.2 Stable Poles, Unstable Poles, Left-Half-Plane Pole, 

Right-Half-Plane Pole 

The pole is called a right-half-plane (RHP) pole (or unstable pole) if the real part of the pole is 
positive. Similarly, if the real part of the pole is negative, then it is called a left-half-plane (LHP) 
pole (or stable pole). When locating on the pole in Figure 3.8, it can be understood why they are 
termed thus. 

Here, Re(p) and \m(p) denote the real part and the imaginary part of the pole. The LHP means 
the left part of the y-axis in Figure 3.8. The —1.5 + l.Oi and —1.5 — l.Oi poles belong to the 
LHP. The 1.5 + l.Oi and 1.5 — l.Oi poles belong to the RHP. Because the RHP pole has a 
positive real part, it is called the unstable pole. The LHP pole has a negative real part. Thus, it is 
called the stable pole. 


Im(p)' 



-1.5+1.0i 

( 0+0i 

1.5+1.01 

• 



R e(p) 

—1.5—1 -0i 


1.5-1.0i 


Figure 3.8 Pole positions. 
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3.3.3 Open-Loop Stable and Unstable Processes 

If the process output is stable and converges to a constant value for a step process input, then it 
is called an open-loop stable process. Otherwise, it is called an open-loop unstable process. If the 
process has a transfer function in which the poles are located on zero, then it is called an integrating 
process. And the process is called an unstable process if it has a transfer function in which some of 
the poles have positive real parts. For example, G(s)= exp(—0.l5)/[5(5 + 1)] and G(s) = exp 
(-0.l5)/[5 3 (5 + 1)(5 + 0.1)] are integrating processes and G(s) = exp(—0.1 j)/[(s + 1) 
(10^— 1)] and G(s) = exp(—0.25)/[(5 — 0.1 + 0.010(5 — 0.1 — 0.010] are unstable processes. 
The integrating process and the unstable process are open-loop unstable processes. 


3.3.4 Relationship Between Zeroes and Dynamic Behaviors 

Zeroes determine the initial dynamics of the process output for an abrupt change of process 
input. Attention needs paying to the fact that the numerator of the transfer function corresponds 
to the differentials of the process input. If there is an abrupt change in the process input, then the 
differential terms in the numerator become large. Meanwhile, the differential terms are 
negligible for a smooth process input. Consider the following examples. 

Example 3.9 

Case 1 has the large zero of 10, Case 2 has a small positive zero of 0.1 and Case 3 has a small 
negative zero of —0.1. 


Case 1 : 

y(s) -0.15+1 
u(s) 5 2 + 25 + 1 

(3.33) 

Case 2 : 

y(s) -105+1 

U(s) 5 2 + 25+l 

(3.34) 

Case 3 : 

y(s) 105+1 

U(s) 5 2 + 25+l 

(3.35) 


The numerators of the three cases correspond to the differentials —0.\du{t)ldt + u(t), 
— lOd u(t)/dt + u(t) and 10d«(t)/df + u(t) respectively. Assume that the process input u(i) 
changes from zero to a positive value abruptly. Then, du(t)/dt will be a large positive value at the 
instant of the abrupt change and du(t)/dt will go back to zero after the instant. Consider the 
simulation in Figure 3.9. The process input u{t) is a step signal ( u{t) = 1 for t > 0, u(t ) = 0 for 
t< 0). 

Note that —0.\du{t)ldt + u(t), ~\Qdu(t)ldt + u(t) and \Qdu(t)ldt + u(t) of the three cases 
are the same for t > 0 because du(t)/dt = 0 at t > 0. So, although the initial responses are totally 
different from each other, the late parts of the three step-responses converge on each other. The 
positive value of 10dw(/)/dt at t = 0 in Case 3 is much bigger than —0.1 du(t)!dt at t = 0 in 
Case 1, so that the process output of Case 3 deviates positively from the process output of Case 1. 
The big negative value of —10 du(t)/dt at t = 0 in Case 2 drags the process output down initially. 
In Case 2, the initial direction of the process output is opposite to the direction of the late part. 
This is called the inverse response. 
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In summary, a small positive zero produces an inverse response or drag down of the process 
output initially for a positive step input. A small negative zero initially drags up the process 
output for a positive step input. 

3.4 Block Diagram 

A block diagram is a useful tool to show signal flows in a systematic way between the transfer 
functions (blocks). Consider the following examples to understand the relationships between 
the block diagram and the transfer functions and several important properties of the block 
diagram. 

Example 3.10 

The following block diagram is equivalent to Equations (3.36)—(3.38): 



The input and the output of the first transfer function (block) are y s (s ) — y(s) and u(s) 
respectively. The transfer function of the first block is 2.0; that is, u(s)/y s (s) — y(s) = 2. So: 

u(s) = 2.0(y s (s)-y(s)) & u(t ) = 2.0(y s (t) -?(*)) (3.36) 

In a similar way, u(s) and y(s) are the input and the output of the second transfer function (that 
is, y(s)/u(s) = exp(—0 ,2s)/(s + 1) respectively. Then, (3.37) is derived: 


jy(s) d-yC 5 ) = «(j)exp( - 0.2 j) 


«+*)=„(,- 0 . 2 ) 


(3.37) 
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From (3.36) and (3.37): 


Ms) +y(- y ) = 2.0(y s (j) -3’(^))exp(-0.2j) ^ + y(t ) = 2.0(y s (t-0.2)-y(t-0.2)) 

(3.38) 

Meanwhile, the transfer function from y S (s) to >’(.s) can be derived in a straightforward way. 
By multiplying y(s)/u(s ) = exp(—0.2.y)/(,y + 1) and u(s)/(y s (s) — y(s)) = 2 the transfer function 
from y s (s) — y(s) to y(,y) is obtained as follows: 

y(-y) = 2exp(-0.2.y) 


Equation (3.39) can be rewritten to the following transfer function from v s (,v) to y(,y). 


y(s) _ 2 exp( — 0.2s)/(s + 1) 

y s (.y) l + 2exp(-0.2.y)/(.y+1) 


Example 3.11 

Obtain the overall transfer function from u(s) to y(s) for the following block diagram, in which 
several transfer functions are connected sequentially. 


Solution From the block diagram, Vi (s)/u(s) = Gi(.y), v 2 (.s)/vi (.y) = G 2 (s) and y(s)/v 2 (s) = 
G 3 (y). Then, it is straightforward to obtain y(s)/u(s) = G l (s)G 2 (s)G 2 (s) by multiplying the three 
terms. 


Example 3.12 

Obtain the overall transfer function from U\{s ) and u 2 (s) toy(,y) for the following block diagram, 
in which the outputs of the two blocks are added, followed by the two transfer functions: 



Solution From the block diagram, v t (s)/u\(s) = G,(.y), v 2 (s)/u 2 (s) = G 2 (s), v,(,y) - v 2 (j) = 
v(j) and y(s)/v(s) = G 3 (s)G 4 (s). That is, Vi(^) = Gj(s)ut(s), v 2 (s) = G 2 (s)u 2 (s) and y(s) = 
Gt,(s)G 4 (s)(V](s) — v 2 (s)). Then, it is straightforward to obtain (G,(,v)wi(.y) — G 2 (s)u 2 (s)) 
G 3 (.y)G 4 (.y) = y(,y). 
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Example 3.13 

Obtain the transfer functions from d(s ) to y(s), from y s (s) to y(s) and from d(s) and y s (.y) to y(s) 
for the following block diagram: 



Solution Let us assume y s (s) = 0 to obtain the transfer function from d(s) to y(,y). Then, 
(— y(s)G c (s) + d(s)G d (s) — y(s)G i (s))G p (s) = y(s ) can be obtained in a straightforward manner 
by considering Examples 3.11 and 3.12. This can be rewritten as follows: 


yQO _ G p (s)G d ( s ) 

d(s) l + G p (s)Gi(s) + G p (s)G c (s) 


Let us assume d{s) = 0 to obtain the transfer function from yds) to y(s). Then, ((yds) — y(s)) 
G c (s) — y(s)Gi(s))G p (s) = y(s) is obtained in a straightforward manner. That is: 

y( J ) = n 42) 

y s (s) l + G p (s)Gi(s) + G p (s)G c (s) [ ' J 

Using the superposition rule, the transfer function from d(s) and yds) to y(s) is obtained by 
adding the two transfer functions (3.41) and (3.42): 


yCO = 


G p (s)G d (s) 

1 + G p (j)Gi(,s) + G p (s)G c (s] 


■dW4 


1 + G p (s)Gi{s), + G p (s)G c (s] 


■y. CO (3-43) 


3.5 Frequency Responses 

The frequency responses have been widely used in the research area of process control and 
process identification. Estimating the frequency responses of the process from the process data 
is one of the most important things in process identification. Also, analyzing techniques on the 
basis of the frequency responses have played an important role in designing process controllers 
and analyzing the stability of the closed-loop control system. In this section, the frequency 
response is defined and the relationship between the frequency response and the transfer 
function is discussed. The ultimate frequency and the ultimate gain are then defined, which 
are extremely important for proportional-integral-derivative (PID) controller tuning. Finally, 
the Bode plot and the Nyquist plot for graphic representations of the frequency responses are 
introduced. 
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3.5.1 Frequency Responses of Linear Processes 

Consider the following important fact. When you enter a sine signal input u(t) = a sin(ojt) into a 
linear process for a long time, the process output always becomes a sine signal of the same 
frequency, like y(t) = b sin(<ot + c), as shown in Figure 3.10. In this case, the ratio of the 
amplitude of the process output to that of the process input (i.e. bta) is called the amplitude ratio 



Figure 3.10 Typical response of a process output for a sine signal. 


of the process (denoted by AR(tu)) and the phase difference c between the process output 
and the process input is called the phase angle of the process (denoted by <(>(a>)). In other words, 
the process output is y{t) = aAR(cu) sin(cut + (f) (a>)) for the process input u(t) = a sin(cuf) in 
cyclic-steady-state. The set of the amplitude ratio AR(co) and the phase angle <(>(&>) is called 
the frequency response of the process. The frequency response is a function of the frequency co. 

Usually, the process output is lagged backward so that <(>(«) is negative. Also, the magnitude 
of the phase angle l</>(cu)l becomes bigger and the amplitude ratio becomes smaller monotoni- 
cally as the frequency of the sine input signal increases. 

Example 3.14 

Assume that you use a sine signal to activate the process. After entering the process input 
u(t ) = 5.2 sin(0.5t) for a long time, you find the process output y(0 =1.3 sin(0.5f — 7t/6). In this 
case, the amplitude ratio AR(u>) is 0.25 and the phase angle <(>(«) is —jt/6 at a frequency of 0.5. 

Example 3.15 

Assume that you perform two experiments using two different sine signals. In the first 
experiment, you find the process output y( t) = 1.5 sin(0.5f — 7t/10) after entering the process 
input u(t) = 3.0 sin(0.5t) for a long time. Next, you perform the other experiment with 
u(t) = 6.0 sin(l.Ot) and find y(t) =1.5 sin(1.0t — it/4). In this case, two frequency responses of 
the process are obtained: AR(0.5) = 0.5, <(>(0.5) = —Jt/10 and AR(1.0) = 0.25, <(>(1.0) = —7t/4. 

3.5.2 Estimating Frequency Responses from the Transfer Function 

The frequency response of the process can be obtained directly from the transfer function without 
simulation or plant test. Assume that G(s) of the transfer function of the process is available. 
Then, the amplitude ratio and the phase angle can be estimated by the following equations. 

ARM = |G(iw)| = ^Re(GM) 2 + Im(G(iu>)) 2 
<(>(«) = ZG(iw) = arctan for Re(G(i«j)) andIm(G(iw)) 


(3.44) 

(3.45) 
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Equations (3.44) and (3.45) are equivalent to the complex number (3.46) because exp(i / G- 
(i<w)) = cos(/G(iw)) + /'sin(/G(ica)). 

GM = |GM|exp(i/G(i W )) (3.46) 

Now, G(iw) can be calculated from (3.46) if the amplitude ratio and the phase angle are 
given. 

Proof 

Assume G(s) is stable and a strictly proper transfer function and the structure of the transfer 
function is 


_ k(s - zi)(s - z 2 ) ■ ■ ■ (s - z m ) 
{S -Pl){s -p 2 ) ■ ■ ■ {S -p n ) ' 


n>m 


(3.47) 


where all poles are distinct. For the process input u(t) = a sin(wt), of which the Laplace trans¬ 
form is u(s) = aoj/(s 2 + co 2 ), the process output will be 


m--, 


acoG(s) 


kcuo(s - zi){s - z 2 ) ■ ■ ■ (s - z m ] 


" (j-ifiOCs + iaO (j-/»i)(j-/»2)---(j-/»„)(5-ia»)(j-|-ui 

Then, (3.49) is obtained by the partial fraction 


y(s) = - 


A„ aG{ iw) 1 aG(-iw) 1 
s—p n 2i s — i(Q — 2i i' + iw 


(3.48) 


(3.49) 


s-p l s-p 2 

where A k is a constant. So, the process output in the time domain is 
y(t) =A\ exp(pif) 

Note that G(s) is stable, so the real parts of all the poles except i co and —i co are negative. Then, 
all the terms except exp(— iwt) and exp(i cot) will decay to zero after a long time. As a result, the 
final process output is 


. . aGfioo) aG( — 

y(t) = —— exp(ia>f)- - 


—exp(— i cot) 


(3.51) 


Note that G(i&») = Re(G(iw)) + i Im(G(iw)) means G(—iw) = Re(G(i&>)) — i Im(G(iw)), 
resulting in IG(iw)l = IG(—i<w)l and /G(ico) = —/G(—\co). From the three equations G(ico) = 
IG(iw)lexp(//G(iw))a, /G(i<u) = — ZG(—iw) and IG(iw)l = IG(—i<u)l, (3.52) is obtained. 


y(t) = a l G ( iM)l expM + i/GM) — I exp( — i cot — iZG(itu)) (3.52) 


This can be rewritten as (3.53) by using the Euler formula sin(x) = (exp(ix) — exp(—ix))/(2i): 

y(t) = a|G(i<u)|sin(<uf+ ZG(i<u)) (3.53) 
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Equation (3.53) proves (3.44) and (3.45). That is, if the process is strictly proper and stable 
then the process output becomes y(t) = a\G(\a>)\ sin(wt + ZG(iw)) for the process input 
u(t) = a sin(wt). This means that the amplitude ratio is IG(i<w)l and the phase angle is ZG(i<u). 
The proof can easily be extended to the case that some poles are multiple roots. 

Note that the frequency response for the zero frequency (a) = 0) is G(0) from G(ica). And, note 
that G(0) is the static gain (that is, G(0) = y ss /w ss ) for the open-loop stable process because setting 
s = 0 means steady state (that is, all the derivatives are zero). For example, G(0) is k = y ss /M ss for 
the FOPTD process of G(s) = &exp(— 0s)/(zs + 1). So, the frequency response for the zero 
frequency is the same as the static gain for the open-loop stable process. 

Example 3.16 

Assume that G(s) = G\(s)G 2 (s)- ■ G„(s) and G/ C (iw), k - 1,2,...,«, are given. Then, IG(iw)land 
/G(\a>) can be easily obtained from the following equations: 

|G(ia»)| = |G 1 (i«)||G 2 (W)| • • • |G„(iaj)| (3.54) 

ZG(iw) = ZGi(iw) + ZG 2 (iw) + • • • + ZG„( iw) (3.55) 

This can be derived directly by using the representation Gj-(iw) = IG/,(iw)l exp(iZG/ c (im)). 

Example 3.17 

Predict the process output in the case that you enter the process input u(t ) = 2.0 sin(l.Ot) into 
the linear time-invariant process of which the transfer function is G(s) = exp(—O.ls)/ 

Cs + 2) 2 . 

Solution Because IG(il.0)l = 0.2 and ZG(il.O) = —1.027, y(t) = 0.4 sin(l.Of — 1.027). 

Example 3.18 

Predict the process output in the case that you enter the process input u(t) = 2.0 sin(l.Ot) + 
3 sin(1.5t) into the process of which the transfer function is G(s) = exp(—0.1x)/(,y + 2) 2 . 

Solution Because IG(il.0)l = 0.2 and ZG(il.O) =—1.027, y(t) = 0.4sin( 1.0? — 1.027) for 
u(0 = 2.0sin(1.00. And y(t) = 0.48 sin(1.5t— 1.437) for M(f) = 3.0sin(1.5f) because 
IG(il.5)1 = 0.16 and ZG(il.5) = —1.437. By the superposition rule, the solution is y(t) = 0.4 
sin(1.0f — 1.027) + 0.48 sin(1.5t - 1.437) for w(0 = 2.0sin(1.0t) + 3 sin(1.5f). 


Example 3.19 

You obtained y{t) = 0.3 sin(0.5t — tc/ 8) for u(t) = 1.0 sin(0.5t) from an experiment. Find 
G(0.5i) for the process. 


Solution The amplitude ratio AR(0.5) = G(0.5i) = 0.3 and the phase angle 0(0.5) = 
ZG(0.5i) = —Jt/8 are obtained from the experiment. So, the solution is G(0.5i) = IG(0.5i)l 
exp(iZG(0.5i)) = 0.3 exp(—ijt/8) = 0.277 — iO.l 15. 
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Example 3.20 

You obtainedy(f) = 0.8 sin(0.5/ — 7t/8) + 0.5 sin( 1 ,()t — tt/ 4) + 0.1 sin(3.0/ — 37t/4) + l.Ofor 
u(t) = sin(0.5/) + sin(l.Ot) + sin(3.0/) + 1.0 from an experiment. Find G(0.5i), G(1.0i), G 
(3.0i) and G(0.0) for the process. 

Solution By the superposition rule, the process would show y(f) = 0.8 sin(0.5/— 7t/8) for 
u(t) = sin(0.5f), y(t) = 0.5 sin(1.0/ — 7t/4) for u(t) = sin(l.Ot), y(t) = 0.1 sin(3.0t - 3tt/4) for 
u(t) — sin(3.0t) and y(t)= 1.0 for u(t)= 1.0. So, G(0.5i) = 0.8 exp(-i7t/8), G(1.0i) = 0.5 exp 
(—in/4), G(3.0i) = 0.1 exp(-i3tt/4) and G(0.0)= 1.0/1.0. 

3.5.3 Ultimate Gain (Ratio) and Ultimate Frequency 

Assume that you enter a sine signal a sin(cuf) into a process for a long time and then the 
process output becomes a sine signal of the same frequency a>. In this case, if the process output 
is lagged by — n (that is, y( t) = b sin(wf — n)=—b sin(wf) for u(t) = sin(tnf), and equivalently 
ZG(ito) = — 7t) for the frequency oj, as shown in Figure 3.11, then the frequency is the ultimate 
frequency cu u . Also, the ultimate gain is k cu = alb, which is the reciprocal of the amplitude ratio 
(k cu = l/AR(w u ) or k cu = l/IG(iw u )l) for the ultimate frequency. 



Figure 3.11 Response of a process output for a sine signal of ultimate frequency <n u . 


Example 3.21 

After performing many experiments changing the frequency, you find that the process output 
is y(t) = — 1.3 sin(2.2/) for the process input u(t) = 2.6 sin(2.2f). Then, the ultimate fre¬ 
quency, the ultimate period and the ultimate gain of the process are 2.2, 2n/2.2 and 2.0 
respectively. 


Example 3.22 

The ultimate frequency can be estimated directly by solving /G(ia> u ) = —n (and equivalently 
Im(G(iw u )) = 0) if the transfer function G(s) of the process is given. Then, it is straightforward 
to estimate the ultimate gain k cu = l/IG(i<u u )l. Find the ultimate frequency, the ultimate period, 
the ultimate amplitude ratio and the ultimate gain for the process of which the transfer function 
is G(s) = exp(—0.2 s)/(s + 2) 2 . 


Solution The MATLAB code to estimate the ultimate frequency data using the bisection 
method and the results are shown in Table 3.1. The bisection method estimates the ultimate 
frequency by finding the root of Im(G(iw„)) = 0. 
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3.5.4 Bode Plot and Nyquist Plot 

A Bode plot is a set of two graphs of the amplitude ratio and the phase angle with respect to 
frequency. A Nyquist plot is a graph in which the x-axis is the real part and the y-axis the 
imaginary part of the frequency response G(iu>). 

Example 3.23 

Let us draw the Bode plot and Nyquist plot for the following processes: 

Gt(s)=— l —, G 2 (s)=--— T , G 3 (s)=--—t (3.56) 

W 2s+1 2W (2, + l) 2 W (2s + 1) 3 ^ ' 

<?4 W = ex p( - 0.2,), G 5 (4 = eXP 2 ( ,~° 1 2 ' ) (3-57) 

From Gi(i&>) = l/(2<ni + l) = (-2«i + l)/(4w 2 + 1) = 1/(4 w 2 + 1) + i(-2cu)/(4cu 2 + 1) 
we have Re(Gi(iw)) = l/(4cu 2 + 1) and Im(Gi(icu)) = (—2w)/(4tu 2 + 1). Then, it is straight¬ 
forward to draw the Nyquist plot by plotting Re(Gi(iw)) versus Im(Gi(iw)) with changing 
frequency cu, as shown in Figure 3.12. Here, PA denotes the phase angle. 


Table 3.1 MATLAB code to estimate the ultimate frequency data using the bisection 
method in Example 3.22. 
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/Gi(iw) = tan _1 (Im/Re) = —tan _1 (2w) and |Gi(i«)| = l/|2n»i + 11 = + 1. 

Now, it is straightforward to draw the Bode plot, as shown in Figure 3.13. Here, the scales 
of the x-axis and the y-axis of the amplitude ratio plot in the Bode plot are logi 0 IGi(kn)l and 
logiow. The scales of the x-axis and the y-axis of the phase-angle plot in the Bode plot are 
ZGi(ku) and logio<u. 

Note that |G 3 (iw)| = |l/(2wi+l)||l/(2wi+l)||l/(2wi+1)| = l^^tn 2 + l) 3 and 
/G 3 (iw) = 3/Gi(iw) = —3 tan _1 (2u>). Thus, the Nyquist plot and the Bode plot are as shown 
in Figures 3.14 and 3.15. 



< 10“ 2 10- 1 10° 10 1 



CL -100'-‘— . .‘— . .‘— . 

10“ 2 10” 1 10° 10 1 


co 


Figure 3.13 The Bode plot of G, 
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Re(G) 


Figure 3.16 The Nyquist plot of G 4 (i«) and G 5 (i&>). 


Example 3.24 

The ultimate frequency of G 3 (s) can be guessed from the Bode plot of Figure 3.15 by checking 
the frequency corresponding to the phase angle of — 180°. Then, it is straightforward to measure 
the ultimate gain of Gj,(s) by checking the amplitude ratio corresponding to the ultimate 
frequency. The ultimate gain can also be measured from the Nyquist plot in a similar way. Gi(s) 
and G 2 (s ) have no ultimate frequency because they never cross the phase angle of —180°. 



Figure 3.17 The Bode plot of G 4 (i&>) and G 5 (i<w). 
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Example 3.25 

Using a computer program, the plots can be drawn in a very simple way. Program the MATLAB 
code to draw the Bode and Nyquist plots for Gs(s) = exp(— 0.2s)/(2s + 1). 

Solution The MATLAB code to draw the Bode plot and the Nyquist plot of G 5 (i&>) is shown in 
Table 3.2. Here, arctan 2(Im, Re) returns the phase angle of the complex number of Re + i Im. 
It returns the phase angle ranged from — n and + n while arctan(Im/Re) returns the phase angle 
ranged from —Jt/2 and + Jt/2. 

Problems 

3.1 Explain the following terms: 

(a) time constant, time delay, static gain, FOPTD model; 

(b) damping factor, underdamped process, overdamped process, overshoot, decay 
ratio, settling time, SOPTD model; 

(c) step input response, PRC method; 

(d) poles, zeroes, transfer function, inverse response; 

(e) block diagram, amplitude ratio, phase angle, frequency response; 

(f) ultimate gain, ultimate frequency, ultimate amplitude ratio; 

(g) Bode plot, Nyquist plot. 


Table 3.2 MATLAB code to draw the Bode plot and the Nyquist plot of G 5 (ioj). 
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Figure P3.1 


3.2 Estimate the FOPTD model for the step response shown in Figure P3.1. 

3.3 Estimate the SOPTD model for the step response shown in Figure P3.2. 

3.4 Run the real-time virtual processes (refer to Appendix for details) and choose Process 1 
and code the step test using a MATLAB m-file and perform the step input test to Process 1. 
Now estimate the FOPTD model to fit the step response of Process 1. 

3.5 Perform the step input test to the virtual process Process 2 (refer to Appendix for details) 
and estimate the SOPTD model to fit the dynamics of Process 2. 

3.6 Perform the step input test to the virtual process of Process 3 (refer to Appendix for 
details) and estimate the FOPTD model for Process 3. Note that the process output and the 
process input are not zero initially. So, you need to define new deviation variables for the 
process input and output. 

3.7 Solve Problem 3.6 again with Process 4 (refer to Appendix for details) and the SOPTD 
model. 

3.8 Find the poles and the zeroes for the following processes: 

y(s) ,-0.5 

u(s) (5+1) (s + 2) 
y(j) _ 5 +0.5 

u(s) (5 2 + 5+ l)(j+ 1) 


(b) 
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3.9 Find all the processes that show unstable response, stable response, oscillatory response, 
nonoscillatory response and inverse response respectively for a step process input among 
the following processes: 

y(s) 10(5+5) (5+10) 

K) u(s) (j+1)(s + 2)(j + 3)(j + 4) 
fbt yC?) . exp(-o.lj) 
u(s) s 2 + 0.5 s + 1 

, x y(j) (0.5.V+ l)exp( — O.Lv) 
u(s) 5 2 -5+l 


(d) 


u{s) 


-105+2 

(5 2 + 25+l)(25+l) 


y(s) _ 55+1 

u(s) 5(25+1) (35+1) 


(f) 


u(s) 


-55+1 

5 3 (25+ l)(3s+ 1) 
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Figure P3.3 


/ \ y(s) _ exp( - 0.3,?) 
u(s) (j+l)(s + 2)(s-l) 

3.10 Consider the block diagram in Figure P3.3. 

(a) Find the transfer function from y s (.?) to y(s). 

(b) Find the transfer function from di(s) to y(s). 

(c) Find the transfer function from d 2 (s ) to y(s). 

(d) Find the relationship between y s (s), d\(s), d 2 (s ) and y(s) using the above-obtained 
transfer functions. 

3.11 You obtain the process output y(t) = 0.5 sin(2f — 7t/2) for the process input u(t) = 2 sin 
(2 1) for a given process. Find the process outputs of the given process for the following 
process inputs: 

(a) u(t) = 4sin(2t) 

(b) u(t) = 2sin(2t —Jt/4) 

(c) u(t) = sin(2t +Jt/2). 

3.12 You perform two sine input experiments. In the first experiment, y(t) = 0.25 sin(2f — 3 k/ 4) 
is obtained for u(t ) = sin(2f). Then y(t) = 0.5 sin(f — 7t/4) for u(t) =sin(f) is obtained in the 
second experiment. Find G( li) and G(2i). Here, G(s) is the transfer function of the process. 

3.13 You perform a step input test and a sine input test. y(t ) = 2 is obtained for u(t) = 1 from the 
step test and y(t ) = 0.7 sin(3t) for u(t) = sin(3t + 7t/6) is obtained from the sine test. Find 
G(0i) and G(3i). 

3.14 You obtain the process output y(t) = 2+ (2/\/2)sin(2t — 37t/4) for the process input 
u{t ) = 1 + sin(2t) for a given process. The process is an FOPTD process described by 
z{Ay{t)/At) +y(t) = ku(t — 6). Find the parameters t, k and 6. 

3.15 Obtain the process output y(t) for the process input u(t) = 0.5 sin(t + jt/4) + 2 sin 
(2 1 — 7t/4) + 3. The transfer function of the process satisfies G(0i) = 5, G(li) = — 1 — i 
and G(2i) = —0.5. 

3.16 The ultimate frequency and the ultimate gain of a process are 1.5 and 5.0 respectively. 
Find G(1.5i). Here, G(s) is the transfer function of the process. 
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3.17 Find the ultimate frequency, the ultimate period and the ultimate gain for the process 
G(s) = Mis + l) 5 . 

3.18 Draw the Bode plots and the Nyquist plots for the following processes and select all the 
processes that have the ultimate frequency: 

(a) G{s) 

(b) G(s) = 

(c) G(s) = 

(d) G(s) = 


(105+ l) 2 


10exp(-0.l5) 

(105+l) 2 

(e) G(5) =exp(-5). 
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Part Two 

Process Control 


Process control is about making the process output behave in the desired way by manipula¬ 
ting the process input in an automatic way. Process controllers have contributed much to 
improving the quality of products and reducing utility consumption. In this part, the PID 
controller and the tuning methods are introduced in Chapters 4 and 5. The two chapters are 
extremely important to understanding the basic concepts of feedback process control and 
various real-world controllers implemented in industry. Chapter 6 introduces several 
important tools (Bode plot and Nyquist plot) and terms (characteristic equation, critical 
frequency and gain, gain margin and phase margin) to analyze/describe the closed-loop 
dynamic characteristics of the designed feedback controller. Enhanced control strategies 
using additional measurements and the process model, which have been widely used in 
industry, are discussed in Chapter 7. 




4 


Proportional-Integral-Derivative 

Control 


PID controllers have been most widely used in industry due to their simplicity, good control 
performance and excellent robustness to uncertainties. In this chapter, the structure of the PID 
controller and the roles of the three parts (proportional, integral and derivative) of the PID 
controller are discussed, followed by the practical issues related to the PID controller, such as 
the integral windup, implementation and industrial versions of the controller. 

4.1 Structure of Proportional-Integral-Derivative Controllers and 
Implementation in Computers/Microprocessors 

In this section, the structure of the PID controller is explained and their implementation in 
computers or microprocessors is discussed. 

4.1.1 Structure of Proportional-Integral-Derivative Controllers 

PID controllers are composed of the following three parts: 

Proportional (P) part : up(t) = k c (y s (t) —y(t )) (4.1) 

Integral (I) part: ui(t) = — [ (y s (r) -y(r)) dr (4.2) 

T i Jo 

Derivative (D) part: Uu(t) = A: c Td ^^' Vs ^^ —(4.3) 
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The output of the PID controller is the sum of the above-mentioned three parts: 
u{t) = up(t) + Ul (t) + u D {t) = k c {y s (t) -y(t)) + ^ J (y,( T ) -*$) dT + fc c T d d ^ s ^ 

(4.4) 


where y s (t), y(t) and u(t) denote the setpoint (the desired process output), the process output 
and the control output of the PID controller respectively. The constants k c ,x t and r d are called 
the ‘proportional gain’, the ‘integral time’ and the ‘derivative time’ respectively. Sometimes, 
the term proportional band (PB) is used instead of the proportional gain of k c . The PB is 
defined as PB = (w max — u min )/k c , where, M max and u min are the upper limit and the lower limit 
of the control output (equivalently, the actuator output). For example, PB= 100 lk c in the 
case of w max — w min = 100. So, the proportional gain k c can be calculated simply if the PB is 
given. 

As shown in (4.4), the PID controller is just a simple function of which the input is y s (t ) — y(t) 
and the output is u{t). It has been most widely used in industry and it is famous for its simplicity 
as well as the excellent control performance and robustness. The PID controller has the three 
tuning parameters k c , x and r d , which should be set appropriately with in-depth consideration 
of the process dynamics. 

The setpoint y s (i) and the parameters k c , x t and t d are set by the user. The process output y(t) is 
measured. Then, it is straightforward to calculate the output of the PID controller. The outputs 
of the integral part ui(t ) and the derivative part u n (t) are usually calculated by the numerical 
integration method and the numerical derivative method respectively. For detailed descriptions 
on the numerical integration and the numerical derivative, refer to Chapter 2. 

Example 4.1 

Calculate the output (u(t) for f > 0) of the PID controller if yjt) = 1 for t > 0 and y(t) = 0 for 
t > 0. The parameters are k c = 1.0, Xi = 5.0 and x d = 0.2. 

Solution w P (0= 1.0(1.0-0.0) = 1.0 for t> 0, m(t) = 1.0 J 0 '(1.0 - 0.0) df/5.0 = t/5.0 for 
f>0 and M D (t) = 0.2d(1.0 —0.0)/df = 0.0 for t>0. So, u(t) = 1.0 + tl 5.0. 

Example 4.2 

Calculate the output ( u{t) for t > 0) of the PID controller if y s (t) = 1 for t > 0, y s (t) = 0 for t < 0 
and y(t) = 0. The parameters are k c = 1.0, t,- = 5.0 and r d = 0.2. 

Solution u P (t)= 1.0(1.0-0.0)= 1.0 for t> 0, ui(t) = 1.0 J 0 '(1.0 - 0.0) df/5.0 = t/5.0 for 
t > 0, m d (0 = 0.2d(1.0 - 0.0)/dt = 0.0 for t > 0, u D (t ) = oo for t = 0. So, u(t) = 1.0 + tl 5.0 for 
t > 0 and u(t) = °° for t = 0. 

Example 4.3 

Calculate the output ( u(t ) for t > 0) of the PID controller if y s (t) = 1 for t > 0, y s (t) = 0 for t < 0 
and y(t) = 1 — exp(— t) for t >0, y(t) = 0 for t < 0. The parameters are k c = 1.0, x t = 5.0 and 
r d = 0.2. 
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Solution M P (i) = exp(— t) for t>0, u\{t) = exp( — x) di/5.0 = [1 — exp( — t)]/5.0 for 
t> 0, m d (0 = -0.2exp(-t) for t> 0, u D (t) = °° for t — 0. So, w(f) = 0.6exp(— t) + 0.2 for 
t > 0 and u{t ) = °° for t = 0. 

Example 4.4 

What is the transfer function of the PID controller (4.4)? 

Solution The input and the output of the PID controller are y s (t) — y{t) and u(t) respectively. 
Then, the transfer function is 


0 c(s) =*f> =k+ i 

y s (s)-y(s) x 


4.1.2 Implementation of Proportional-Integral-Derivative Controllers 
in Computers/Microprocessors 

Use the following three steps to implement the algorithm of the PID controller in computers 
or microprocessors. First, read the process output from the sensor. Second, calculate the 
control output of the PID controller. Third, send out the control output to the actuator. In the 
second step, the integral part and the derivative part can be calculated by a numerical 
integration method and a numerical derivative method respectively. Refer to the following 
steps for the detailed descriptions on the implementation of the PID controller. The Euler 
method and the backward difference method are used for the integral part and the derivative 
part respectively. 

1. Read the present (Mi sampling) process output y(k) from the sensor. 

2. Calculate the controller output on the basis of the present and one-step-before data. 

Up(k) = k c (y s (k) —y{k)) proportional part (4.5) 

u\{k) = u\{k — 1) + ^ (y s (k) -y(k))At integral part (4.6) 


«,(*) = 


derivative part 


(4.7) 


u(k) = u p (k) + Ui(k) + u A (k) + u h ias 


(4.8) 


3. Send the controller output to the actuator. When the time passes as much as the sampling 
time At, repeat from step 1 with the k + 1-th sampling. 

Note that the bias term of w hias in (4.8) is usually used to set the reference value of the control 
output. Before you start or restart the PID controller, you should set the bias term to the present 
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control output. Otherwise, a big perturbation at the beginning of the PID control may swing 
the process for quite a while. 

Example 4.5 

Simulate the following third-order plus time-delay process controlled by a PID 
controller using the Euler method with At = 0.01. In this case, w bias = 0 because u(t) = 0 
for f<0. 


^ +3 ^ +3 M + „„ 


-0.3 


dw(t —0.2) 
dt 


+ u{t — 0.2) 


(4.9) 


w(r) = 1.5(y s (f)—y(r))+ ^| o (y 5 (T)-y(r))dT + 1.5 

x O5 d (^(0-y(0) for;>0 u (t) = 0 forr<0 

dr w 


(4.10) 


y s (r) = 1.0 forr>l, y s (r) = 0.0 forr<l 


d 2 y{t) 

dr 2 t =0 


dy(Q 

dt t =0 


= y(o) = o, 


d«(p 

dt t =0 


= «( 0 ) = 0 


(4.11) 

(4.12) 


Solution To solve the high-order differential equation, it should be rewritten to the following 
state-space differential equation according to (1.175)—(1.183). Then, it is straightforward to 
solve the state-space system. 


= Ax(t) + Bu[t - 0.2) (4.13) 

y(r) = Cx{t) (4.14) 

*(0) = [0 0 0] T (4.15) 


'0 o -r 

A= t 0 -3 

.0 1 -3. 

B = [ 1 -0.3 0] T 


(4.16) 


(4.17) 


C= [0 0 


1 ] 


(4.18) 


The MATLAB code to simulate the closed-loop control system (4.9)—(4.12) and the 
simulation results are given in Table 4.1 and Figure 4.1 respectively. Here, s in the code 
corresponds to Ui. The historical data h_u{j) =0, j = 1,2,---, 1000, are initially filled with 
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Table 4.1 MATLAB code to simulate the closed-loop control system of Example 4.5. 


g_pid_exl. m 


t=0.0; 5.0; 

x=[Q 0 0] ' ; y=0.0; yb=0.0; ys=0.0; ysb=0.0; 
delta_t=0.01; n=round(t_final/delta^_t) 

C= [0 0 1] ; theta=0.2; % time delay 
h_u=zeros(1,1000); 
n_theta=round(theta/delta_t); 
kc=l.5; ti=3.0; td=0.5; s=0.0; 

To r..-;i>l : n 

t_array(i)=t; y_array(i)=y; 
ys_array(i)=ys; 

if(t>l) ys=l.Q..; elseys=0.0; end 
s=s +(kc/ti)*(ys-y)*delta_t; 

>6=kc* (ys-y) +s+kc*td* ( (ys-y) - (ysb-yb) ) / 
delta_t; 

ysb=ys; yb=y; % one sampling before 
u_array(i)=u; 

.for j—1: 999 

h_u(j)=h_u(j+1) ; 
end 

h^ur. C00)-u; 

dx_dt=g_pid_exl(y,x,h_u(1000-n_theta)); 
x=x+dx_dt*delta_t; 


function 

[dx_dt]=g_pid_exl(y,x,u) 
A=[0 0 -1; 1 0 -3; 0 1 -3] ; 
B=[l -0.3 0.0] ' ; 
dx_dt=A*x+B*u; 
end 


command window 
» pid_exl 


y=C*x; 

t=t+delta_t; 

end 

figure (1) ; 

plot(t_array,ys_array,t_array,y_array); 
legend('y_{s)(t) ','y(t)'); 
figure (2) ; 

plot(t_array,u_array); 


zero because u(t) = 0 for t< 0. In the case that u bias is set to a nonzero value, this can be 
incorporated by setting the initial value of the integral part. For example, set s = u biSLS instead of 
,y = 0 in Table 4.1 to incorporate M bias / 0. In this example, 5 = 0 because of w bias = 0. 


Example 4.6 

Simulate the third-order plus time-delay process (4.19) controlled by a PID controller using the 
Euler method with At = 0.01. This example is the same as Example 4.5 except that the limits of 
the control output are enforced. 


g& +3 *0 +3 m + , ( ,) = -o.3 d, ^M 


+ u(t-0.2) 


(4.19) 
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y s (t) = 1.0 fort>l, y s (f) = 0.0 fort<l 


(4.22) 


d 2 y{t) 

At 2 ! t _ 0 


dy(Q 
d? t =o 


= y( o) = o. 


d»(0 

d ? /~o 


= «( 0 ) = 0 


(4.23) 


Solution The MATLAB code to simulate the closed-loop control system (4.19)-(4.23) and 
the simulation results are given in Table 4.2 and Figure 4.2 respectively. We realize that the 


Table 4.2 MATLAB code 


date the closed-loop control sysi 


of Example 4.6. 
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Figure 4.2 Simulation result of Table 4.2. 


response of the process becomes sluggish due to the limits of the control output. Also, the 
process output stays above the setpoint for a long time. 

Example 4.7 

Simulate Example 4.5 again with a sampling time A t s = 0.5 for the PID controller. 

Solution The MATLAB code to simulate the process controlled by a PID controller 
for which the sampling time is A t s = 0.5 and the simulation results are given in Table 4.3 
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Table 4.3 MATLAB code to simulate the closed-loop control system of Example 4.7. 


pid_ex3 .rf*. 

g_pid_ex3.m 

clear; 

function 

t=0.0; t_final==2 5.0; 

[dx_dt]2=g_pid_ex3(y, x, u) 

x=[0 0 0] ' ; y=0.0; yb=0.0; ys=0.0; ysb=0.0 i 

A=[0 0 -1; 1 0 -3; 0 1 -3]; 

delta_t=0.01; n=round(t_final/delta_.ft) ; 

B=[l -0.3 0.0] ' ; 

% delta_t for Euler 

dx_dt=A*x+B*u; 

delta_ts=0t_previous=-delta_ts; 
%sampling time for PID 

end 

C=[0 0 1] ; theta=0.2j. % time delay 
h_u=zeros(1,1000) ; 

command window 

n_theta=round(theta/delta_t); 
kc=l ti=3.0; td=0 .5; s=0.0 ; 

for 1=1: n 

t_array(i)=t; y_array(i)=y; 
ys_array(i)=ys; 

% sample the data for PT.7) every delta_ts 
if(t>=(t_previous+delta_ts-delta_t*0.5)) 

» pid_ex3 

if (t>X) ys=l,0; else ys=0 end 

s=s+(kc/ti)*(ys-y)*delta_ts; 

u=kc*(ys-y)+s+kc*td*((ys-y)-(ysb-yb))/ 

delta_ts; 

ysb=ys; yb=y; t_previous=t'ff one 


sampling before 

u_array(i)=u; 

(for l |^L:999 

h_u(|Nh_u(j + l) ; 
end 

h_u (1000)^^; 

dx_dt=g_pid_ex3(y,x,h_u(1000-n_theta)); 
x=x+dx_dt*delta_t; y=C*x; 

^«t+delta_t; 


end 

figure (1) ; 

plot(t_array,ys_array,t_array,y_array); 
legend('y_{s) (t) ' , ' y(t) ' ) ; 
figure (2) ; 

plot(t_array,u_array); 



and Figure 4.3 respectively. Note that the time interval At for the Euler method should be 
small enough to solve the differential equation with acceptable accuracy. So, the code of 
Example 4.5 should be modified as shown in Table 4.3. delta_t*0.5 in the code is just to 
compensate for the round-off error of the computer. Comparing Figure 4.3 with Figure 4.1, 
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Figure 4.3 Simulation result of Table 4.3. 


the larger sampling time can degrade the control performance compared with the case of the 
smaller sampling time because the PID controller of the larger sampling time responds more 
infrequently. 

Example 4.8 

Simulate Example 4.5 again when the process output is contaminated by uniformly 
distributed random noises between —0.1 and 0.1. The sampling time of the PID controller 
is 0.01. 

Solution The MATLAB code to simulate the case of the measurement noises and the 
simulation results are given in Table 4.4 and Figure 4.4 respectively. It should be noted 
that the control output of the PID controller fluctuates severely for the measurement 
noises. This can cause damage to the actuator. The severe fluctuation originates from the 
derivative action of the PID controller. As shown in (4.7), it is clear that the derivative 
action is extremely sensitive to the measurement noises if the sampling time for the PID 
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Table 4.4 MATLAB code to simulate the closed-loop control system of Example 4.8. 


pid_e 


t4.r$i 


g_pid_ex4 .rrvj 


t=0.0; t_final=25.0 ; 

x= [ 0 0 0 ] *'t y“0.0; yb=0.0; ys=0.0; ysb=0.0 ; 

delta_t=0.01; n=round(t_final/delta_t)|£ ' 

C=[0 0 1] ; theta=0.2; % time delay 

h_u=zeros (1,1(300) ; 

n_theta=round(theta/delta_t); 

kc-*&*5; ti=3.0; td=0.5; s=0.0; 

rand (' seed' , 0) jjtoise=0.2* (rand (1, n) - 0.5) ; 

fcbl’^1 : n 

t_array(i)=t; y_array(i)=y; 
ys_array(i)=ys; 

if(t>l) ys=1.0; elseys=0.0; end 
s=s+(kc/ti)*(ys-y)*delta_t; 

•t-kc x (ys-y)-s-kc*td*((ys-y)- 
(ysb-yb) ) /del ta_t>; 
ysb=ys; yb=y; % one sampling before 
u_array (i) 

.for 3=1:999 

h_u(j)=h_u(j +1); 
end 

:ia^ti-(1000)=u; 

dx_dt=g_pid_ex4(y,x,h_u(10 C 0-n_the La)); 
x=x+dx_dt*delta_t; 
y=C*x+noise (i); 
t=t+delta_t; 
end 

figure (1) ; 

plot(t_array,ys_array,t_array,y_array); 
legend('y_{s)(t) ','y(t)'); 
figure (2) ; 

plot(t_array,u_array); 


function 

[dx_dt]=g_pid_ex4(y,x,u) 
A=[0 0 -1; 1 0 -3; 0 1 -3]; 
B=[l -0.3 0.0] ' ; 
dx_dt=A*x+B*u; 
end 


command window 
» pid_ex4 


controller is very small. So, too small a sampling time for the PID controller is not 
recommended. 

Example 4.9 

Simulate Example 4.8 again with a sampling time of 0.1 for the PID controller. 


Solution The MATLAB code to simulate the case of the measurement noises with a sampling 
time of 0.1 and the simulation results are given in Table 4.5 and Figure 4.5 respectively. The PID 
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controller shows an acceptable fluctuation of the control output for a sampling time of 0.1 and 
almost the same control performance as in the case of the very small sampling time of 
Figure 4.4. 

4.2 Roles of Three Parts of Proportional-Integral-Derivative 
Controllers 

The control output Up( t) of the proportional part is proportional to the error y s (t) — y(t ) as shown 
in (4.1). This means that the proportional part plays a role in pushing the process output to the 
setpoint as much as the error. 

For the usual processes (open-loop stable processes), the control output should be a nonzero 
constant to keep the process output to a nonzero setpoint. For example, imagine a control 
system to control the room temperature y(t) of a house in winter by adjusting the fuel 
consumption u(t) of the boiler. It is obvious that a constant amount of the fuel u(t) should be 
provided continuously to keep up an appropriate room temperature (y s = >’(t) = a nonzero 
setpoint). Meanwhile, the following proportional-derivative (PD) controller output is u{t) = 0 
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Table 4.5 MATLAB code to simulate the closed-loop control system of Example 4.9. 



if the error y s — y(t) is zero at steady state: 

«(0 = «p(0+«d( 0 = ^c(ys-y(f)) + fecTd d ^ s (4.24) 


That is, the output of the PD controller cannot be a nonzero constant when the error is zero at 
steady state. So, the PD controller cannot keep the process output to a nonzero setpoint for 
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open-loop stable processes, resulting in an offset. The offset is defined as the error y s (t ) — y(t) 
at steady state. 

The offset can be calculated easily. Equation (4.25) represents the relationship between 
the process output and the controller output at steady state, where k is called the static gain or 
DC gain of the process. Equation (4.24) becomes (4.26) at steady state. 

y ss (t) = ku ss (t) (4.25) 



If the integral part is added to the controller, then the offset can be rejected because 
the integral part can be a nonzero constant even though the present error is zero. That is, (4.4) 
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at steady state becomes (4.28) 

Uss(t) = 

From comparison of (4.25) 
calculated: 


due to the accumulated error if the offset is zero: 

k c (' 

— (>’ s — >’(t)) dr = nonzero constant (4.28) 

Ti Jo ' 

and (4.28), the integral of the error at steady state can be 


(4.29) 


In summary, the conclusion is that the integral part of the PID controller plays an important 
role in rejecting the offset. This is possible because the integral term can be a nonzero constant 
due to the accumulated error. 

T d d(y s — y(t))/dt represents approximately the increment of the error after r d from the present 
time t, as shown in Figure 4.6. Therefore, the derivative part plays a role in rejecting the future 
error in advance by increasing the control output in proportion to the future error. This means 
that the derivative part can enhance the robustness of the PID controller by considering the 
future change of the error. 


Example 4.10 

Find the final values of y{t) and u(t ) of the process (4.30) and the controller (4.31) at steady 
state. Assume that y s (t ) = y SjSS is constant and the signals y(t) and u(t) converge to constant 
values. 


^+2^ +,(,)=«(,-0-5) (430) 

«(<) = i.2(y.(0-y(0)+o.6 d(y,(,) d ~ y(f)) (431) 

Solution At steady state, all the derivatives are zero and the delayed value is the same as the 
present value (that is, y ss (t — G) = y ss (f))- Then, (4.30) and (4.31) become 

*. = «». Mss = 1.2(y SjSS -y ss ) 

Jss = 1.2y s ,ss/2.2 


(4.32) 

(4.33) 
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where the subscript ‘ss’ denotes steady state. Note that the PD controller shows the offset as 
shown in (4.33). 

Example 4.11 

Can the P controller (4.35) reject the offset for the integrating process (4.34) for the constant 
setpoint of y s (t) = y MS ? The integrating process means that the process has a zero pole as shown 
in (4.34): 


- 772 «( J ) 

*(« + 1 ) 


(4.34) 


«C0 =2.5(y s (s)-y(s)) 


(4.35) 


Solution Equations (4.34) and (4.35) are equivalent to the following equations: 


d 3 y(t) , 0 d 2 y(t) 
df 3 + dt 2 


, dy(0 _ 


3«(0 


(4.36) 


«(/);= 2.5(y s (/)-y(/)) (4.37) 

The zero offset means y ss (t) = y SjSS . Then, u ss = 0 from (4.37). The process also satisfies 
0 = w ss at steady state, which means that a zero control output is needed to keep up a nonzero 
process output for the integrating process. So, the offset can be rejected by the P controller. 
Meanwhile, there is always an offset if the P controller is used for an open-loop stable process 
because a nonzero control output is needed to keep up the nonzero process output for the open- 
loop stable process. 


Example 4.12 

Calculate the final value of the integral part of the PID controller (4.38) for the process (4.30) 
when the offset is zero. 


Ti Jo 


u(t) = k c e(t ) + — e(z) dr + k c z d 


. MO 


(4.38) 


Solution Because the offset is zero, e ss (f) = 0. The derivative de ss (t)/dt is zero at steady state. 
So, the output of the PID controller (4.38) becomes u ss = kjz\ J Q r e(z) dr at steady state, which 
is not necessarily zero due to the accumulation of the past errors even though the present error is 
zero ( e ss (t ) = 0). And y s = u ss is valid for (4.30) at steady state. So, y s = k c /r, J 0 e(z) d z. 

Example 4.13 

How can PI (or I, PID) controllers reject the offset for the open-loop stable process? 

Solution Because the controller contains the integral term, the controller output can be a 
nonzero value (corresponding to the setpoint) due to the accumulated integral term even though 
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the present error is zero. Meanwhile, P or PD controllers cannot reject the offset for the open- 
loop stable process because the control output of the P or PD controllers is zero if the present 
error is zero. 

Example 4.14 

Simulate the following SOPTD process controlled by the P controller and confirm that the 
offset converges to the expected value: 


^+ 2 ^+y«) = 0.7„ ( « —0.3) 


u(t) = 3.5(y s (t)-y(t)) fort>0, u(t) = 0 fort<0 


y s (t) = 1.0 fort>l, y s (t) = 0.0 forf<l 
du{t)\ 


= d :K0 

dt 2 L_n d t 


= y( o) = o. 


d? 


= «( 0 ) = 0 


(4.39) 

(4.40) 

(4.41) 

(4.42) 


Solution At steady state, all the derivative values are zero and the delayed value is the same as 
the present value. Then, (4.39) and (4.40) become 

y ss = 0.7 m ss , m ss = 3.5(1-y ss ) (4.43) 

So, the final value of the process output is y ss = 0.7101 and the offset is 1 — y ss = 0.2899. 
The MATLAB code and the simulation results of Table 4.6 and Figure 4.7 respectively 
confirm this. 

Example 4.15 

Simulate the following SOPTD process controlled by the PID controller and confirm that the 
integral part of the PID controller converges to the expected value: 

i# +3 tt +*'> = ?■«) 

u{t) = 3.0(„v s (/) -y(t)) - 3 o J o (-Vs( T ) - v(t)) dr fort>0, u{t) = 0 fort<0(4.45) 


y s (t) = 1.0 for i > 1, y s (f) = 0.0 fort<l 


(4.46) 
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Table 4.6 MATLAB code to simulate the PID control system of Example 4.14. 



Solution At steady state, all the derivative values are zero and the delayed value is the same 
as the present value. Also, the offset is zero because the I term is included. Then, (4.44) 
and (4.45) become 

3.0 

1 = Jss = 0.5 U ss , M ss = (1 — v(t)) dr 


(4.48) 
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Figure 4.7 Simulation result of Table 4.6. 


So, the integral part of (3.0/3.0) Jq( 1 — dr converges to 2.0. The MATLAB code and 
the simulation results of Table 4.7 and Figure 4.8 respectively confirm this. 

4.3 Integral Windup 

Actuators, such as valves, motors, electric powers and so on, always have a lower limit and an 
upper limit. When the actuators are at their limit values (which is called saturation), the 
dynamics of the process output become much more sluggish than the case of no actuator 
limitations for a big step setpoint change or big disturbance. So, the integral part of the PID 
controller increases rapidly. This phenomenon is called the integral windup. Consider the 
simulation result in Figure 4.9. 

As shown in Figure 4.9, the control output (actuator) is saturated from t = 1.0 to t = 9.0. 
During the period from t = 1.0 to t = 5.5, the integral part of the PID controller increases 
rapidly because the error decreases slowly due to the saturation. Note that the final integral 
part of the PID controller is already determined (1.0 in Figure 4.9). Owing to the actuator 
saturation, the integral part up to the rising time would be much bigger than the final value, as 
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Figure 4.8 Simulation result of Table 4.7. 


4.3.1.1 Conditional Integration 

The simplest anti-windup method to prevent integral windup is freezing the integral action 
when the actuator is at the limit value. The code for the anti-windup method is exemplified as 
follows. 

If u(k ) > M max , no update of the integral part like Uj(k) =Ui(k— 1) and set u(k) = w max 

(4.49) 

If u(k) < Wmin, no update of the integral part like Ui{k) = ui(k — 1) and set u(k) = u mm 

(4.50) 

where u min and w max are the lower limit and the upper limit respectively. Then, the calculation of 
the PID control with the anti-windup technique for the /cth sample is summarized as follows: 

u p (k) = k c (y s (k) -y(k)) proportional part (4-51) 
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Figure 4.9 Typical closed-loop responses of a PID control system with actuator saturation. 

k 

Ui(k) = Ui(k— 1) H— ~(y s (k)—y(k))At integral part (4-52) 

„„ derivative part (4.53) 

u(k) = u l lk)+u i (k)+u i (k) (4.54) 

If u(k) > M max , Ui(k) = ui(k — 1) (no update) and u(k) = u rmx (4.55) 

If u(k) < M m in, Uj(k) = Ui(k — 1) (no update) and u(k) = u mw (4.56) 

Other conditional integrations can also be used. For example, the integral action can be 
stopped when the control output or the integral part is larger than a designated value. 
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Table 4.8 MATLAB code to simulate a closed-loop control system with an anti-windup technique of the 
conditional integration. 


pid_antiwindupl.m 

g_pid_antiwindupl 

Clear; 

f unctich. 

t=0.0; •__fina.l-2b . C; 

[dx_dt]=g_pid_anfei*indupl 

x—[0 00]'; y=0.0; yb=0.0; 

(y,x,u) 

ys=0.0; ysb=0.0; 

A=[0 0 -1; : 0 -3; 0 1-3]; 

delta_t=Q.01; 

B=rl0 0.0]'; 

n=round(t_final/delta_t) ; 

dx_dt=A*x+B*u; 

C= [0 0 1] ; theta=0.0; % time delay 
h u=zeros(1,1000) ; 

end 

n_theta=round(theta/delta_t); 
kc=2.0; ti=2.5; td=0.$; s=0.0; 

command window 

for i=l: n 

t_array(i)=t; y_array(i)=y; 
ys_array(i)=ys; T_array(i)=s; 

» pid_antiwindupl 

if(t>l) ys=1.0; elseys=0.0; end 
s_n=s+(kc/ti)*(ys-y)*delta_t; 
u=kc*(ys-y)+s_n+kc*td*((ys-y)- 
(ysb-yb))/delta_t; 
fif .( (u<=l .2) & (u>=-l .2)) s=s_n; end 
it. (u>1.2) u=l. 2; end 
,(u<-l. 2) u—] .2; end 
ysb=ys; yb=y; % one sampling before 
,u_array (i) — lii 
forijsl: 999 
h_u ((j +1) ; 
end 

-|uti(1000)=u; 


dx_dt=g_pid_antiwindupl 
(y,x,h_u(1000-n_theta)); 


x=x+dx_dt*delta_t; y=C*x; 
tKt+ae 1 •_a_L; 


end 

figure (1) ; 

plot(t_array,ys_array,t_array,y_array); 
legend('y_{s) (t) ' , ' y(t) ' ) ; 
figure (2) ; 

plot(t_array,u_array,t_array,I_array); 
legend('u(t)','u_{i)(t) ') ; 



Consider the simulation in Table 4.8 and Figure 4.10. Equation (4.57) is controlled 
by the PID controller k c = 2.0, t, = 2.5 and t d = 0.5 and the anti-windup technique (4.49)- 
(4.56) is used. The lower limit and the upper limit of the actuator are —1.2 and 1.2 
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Figure 4.10 Simulation result of Table 4.8. 


respectively. 


d 3 y(0 ,, d 2 y(t) -dy(r) 

dr 3 d t 2 dr 


mk 

d /2 , o 


0lf) 

dr |L 


= y(o) = o, 


+y(r) = u(t) 

(4.57) 


(4.58) 


The MATLAB code to simulate the closed-loop control system with the anti-windup 
technique and the simulation results are given in Table 4.8 and Figure 4.10 respectively. 


4.3.1.2 Back Calculation 

The other anti-windup technique uses an internal feedback loop, which makes the integral part 
converge to the limit of the actuator. The calculation of the PID control with the anti-windup 
technique of the back calculation for the Mi sample is summarized as follows: 


y (k) = k c (y s (k ) —y(k)) proportional part 


(4.59) 
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„„(*) - fclj (7.W- y W)-(^-D-^-D) 


derivative part 


uvYo(k) = u p (k) + Ui(k) + u d (k) 

If M P id(&) > Mmax, u(k) = M max 
If WpiD (k) < Mmin , u(k) = M min 

If Mpio(fc) > Mmin and mpid (k) < M max , u(k) = Mpid(A:) 


(4.60) 

(4.61) 

(4.62) 

(4.63) 

(4.64) 


m(k + 1) = Ui(k) + |y (u(k) - upiD(k)) + ^ (y p (k) - y(fc))J At integral part (4.65) 

In (4.65), the internal feedback term ( u(k ) — Up m (k))/x t is zero if the actuator is not saturated 
as shown in (4.64). If the actuator is saturated at the upper limit like (4.62), the term decreases 
the integral part Ui(k +1) because the term is negative. On the other hand, it increases the 
integral part if the actuator is saturated at the lower limit like (4.63) because the term is positive. 
So, the term ( u(k ) — Up m (k))/x, in (4.65) makes the output of the PID controller converge to the 
operation range of the actuator. x t is called the tracking time constant. The recommended range 
of the tracking time constant is T d < r t < t,-. 

Consider the simulation in Table 4.9 and Figure 4.11. This is the same as in Table 4.8 except 
that the anti-windup technique used is the back calculation. 


4.4 Commercial Proportional-Integral-Derivative Controllers 

Various modifications of the PID controller are introduced in this section, followed by unified 
structures of commercial PID controllers. Before tuning the parameters of the commercial PID 
controller, one must check the structure of the PID controller because its structure can be totally 
different from the structure of the ideal PID controller of (4.4). 

4.4.1 Noninteracting, Interacting and Parallel 
Proportional-Integral-Derivative Controllers 

The structure of a noninteracting PID controller is the same as that of the ideal PID controller 
in (4.4) as follows: 


G c{s) — , ^ , , = k c + — + k c x d s (4.66) 

,v s (s)-,v(-v) Ti* 

The implementation form of the noninteracting PID controller is demonstrated below. 

u p (k) = k c (y s (k) — y(k)) proportional part (4-67) 


Ui(k) = Ui(k— 1) H— -{y s {k) —y(k))At integral part 


(4.68) 
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u(k) = ufk) + u\{k) 

(4.75) 

The structure of the parallel PID controller is the same as that 
in (4.4), but the definitions of the parameters are different, as she 

of the ideal PID controller 
)wn in (4.76): 

„ / , u(s) kf 

G c (s) = = k p + 

*(*)-?(*) * 

(4.76) 

4.4.2 Relationship between Different Forms of 
Proportional-Integral-Derivative Controllers 


The noninteracting form (4.66) is obtained from the interacting 
parameters as follows. The derivation is straightforward. 

form (4.71) by setting the 


(4.77) 

Ti = %\ + T d 

(4.78) 

. 4*% m 

d WS. 4 

(4.79) 

The interacting form (4.71) is obtained from the noninteracting 
parameters as follows. The derivation is also straightforward. 

: form (4.66) by setting the 

,4 k c + k cy /l -4i d /Ti 
c “ 2 

(4.80) 

j Ti —F Ti \J 1 — 4l d / Ti 

%i ~ 2 

(4.81) 

i _ Ti — T iv /1 -4r d /Ti 

Td “ 2 

(4.82) 

Equations (4.80)-(4.82) are valid only if r,- > 4i d . So, the noninteracting form is more 
general than the interacting form. The two forms of the parallel and noninteracting forms are 
interchangeable with the following relationship: 

k p c =k c , kf = kc . k p = k c r d 

(4.83) 


Example 4.16 

Obtain the interacting PID controller having the same closed-loop response as in Figure 4.1. 
Confirm it with simulation. 

Solution Because the parameters of the noninteracting PID controller are k c = 1.5, T\ = 3.0 and 
r d = 0.5, the equivalent parameters ofthe interacting PID controller are k l c = 1.1830 = 2.3660 
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Table 4.10 MATLAB code to simulate a closed-loop control system with an interacting PID controller. 


pid_interactingl .m 


g_pid_interactingl.m 


1-0.0; u_fina :-2b.0; 

x=[0 0 0]'; y=0.0; yb-0.0; 

ys=C.0; ysb=0.0; 

delta_t=0. 01 j 

n=round (t_final/delta_t) ; 

0 1]; theta=0.2 ; 

% time delay 

h_u=zeros(1,1000); 

n_theta-round (theta/de 1 ta_t) 

kc=l.1830; ti=2.3660; 

td^0v6340; s=0.0; 

for 1- : : r. 

t_array(i) =t; y_array(i)=y; 
ys_array(i)=ys; 

if(t>l) ys=1.0; elseys=0.0; end 
ud= (ys-y)+td*((ys-y) 

-(ysb-yb))/delta_t; 
s=s+ (kc/ti) *ud*delta_f.| 
-f|i=kc*ud+s; 

ysb=ys; yb=y; % one sampling before 
u_array 
for j=l: 999 
h_u(j)=h_u 
end 

h_u(1000)=u; 

dx_dt=g_pid_ interacting 
1(y,x,h_u(1000-n_theta)); 
x=x+dx_dt*delta_t; y=C*x; 
t=t+delta_t; 
end 

figure (1) ; 

plot(t_array,ys_array, 
t_array,y_array); 
legend('y_{s](t)','y(t)'); 
figure (2) ; plot (t_array, u_array) ; 


function 

[dx_dt]-q_p:d_interactingl (y,x,u) 
A=[0 0 -1; 1 0 -3; SI r3] ; 

B=[l -0.3 0.0]'; 
dx_dt=A*x+B*u; 
end 


command window 
>> pid_interactingl 


Tj = 0.6340 by (4.80)-(4.82). The MATLAB code to simulate the closed-loop control system 
with the interacting PID controller and the simulation results are given in Table 4.10 and 
Figure 4.12. As shown in Figure 4.12 and Figure 4.1, the same closed-loop response is obtained. 

Example 4.17 

Obtain the parameters of the parallel PID controller corresponding to the noninteracting PID 
controller k c = 1.5, i| = 3.0 and T d = 0.5. 
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Figure 4.12 Simulation result of Table 4.10. 


Solution The equivalent parameters of the parallel PID controller are k v c = 1.5, fcf = 1.5/3.0 
and ^ = 1.5 x 0.5 by (4.83). 

4.4.3 Two-Degree-of-Freedom Proportional-Integral-Derivative 
Controllers 

The two-degree-of-freedom PID controller uses the following setpoint weighting: 

Up(k ) = k c (w p y s (k) —y(k)) proportional part 


(4.84) 
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Ui(k) = Ui(k — 1) + y(y s (lc) -y(k))At integral part (4.85) 

u d (k) = k c x d (^s (k)-y(k))-(^y s (k-l)-y(k-l)) derivative part (4 86) 
u(k) = u p (k) + Ui (k) + u d (k) (4.87) 


Usually, H’p ranges from 0 to 1 and w d is 0 or 1. w p can reduce the overshoot for a step 
setpoint change without changing the parameters (k c , i\ and x d ) of the PID controller. This 
makes it possible to improve the control performances for the setpoint change without 
degrading the control performances for the input disturbance rejection. The detailed 
descriptions will be given later in this book. w d can prevent the derivative kick, which 
happens when a step setpoint change enters. Consider the simulation results of Figures 4.1, 
4.3, 4.4 and 4.5. Large peaks appear at the instant of the step setpoint change, called 
derivative kick. From (4.86) with w d = 1, it is clear that the derivative kick happens at the 
instant and it becomes severe as decreasing the sampling time. The derivative kick can cause 
damage to the actuator. The choice of w d = 0 can remove the derivative kick, called anti- 
derivative-kick. The control action with w d = 1 is the same as the control action with w d = 0 
except at the instant of the step setpoint change, because the setpoint is constant except at the 
instant. 

Example 4.18 

Simulate again Figure 4.1 with the anti-derivative-kick (tv d =0). Compare the closed-loop 
responses. 

Solution The MATLAB code to simulate the closed-loop control system with the anti- 
derivative-kick and the simulation results are given in Table 4.11 and Figure 4.13. As 
shown in Figure 4.1 and Figure 4.13, the closed-loop response of the anti-derivative-kick is 
a little bit worse than that of the ideal PID controller. Instead, the derivative kick 
is removed. 

Example 4.19 

Simulate again Figure 4.3 with w v = 0.6. Compare the closed-loop responses. 

Solution The MATLAB code to simulate the two-degree-of-freedom PID controller and the 
simulation results are given in Table 4.12 and Figure 4.14. Comparing Figure 4.3 with 
Figure 4.14, the control performance for the setpoint change is improved without changing 
the parameters (k c , %\ and t d ) of the PID controller. 


4.4.4 Noise-Suppressing Proportional-Integral-Derivative Controllers 

The derivative part of the PID controller is very sensitive to measurement noise when 
the sampling time is small, as shown in Figure 4.4. To overcome this problem, the following 
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Table 4.11 MATLAB code to simulate a closed-loop control system with an anti-derivative-kick 
PID controller. 


pid_antiderivativel.m 


g_pid_antiderivativel .ft;: 


clear; 

1-0.0; 5.0; 

x=[0 00]'; y=0.0; yb=0.0; 

ys=0.0; ysb=0.0; 

delta_t=0.01; 

n=round (t_final/delta_t) ; 

C=[0 0 1] ; theta=0.2; 

% time delay 

h_u=zeros(1,1000 )f 

n_theta=round(theta/delta_t); 

kc-1,S? ti=3.0; td=0 s=0.0; wd=0.0 ; 

(or 1- ; : r. 

t_array(i) =t; y_array(i)=y; 
ys_array(i)=ys; 

if(t>l) ys=l.0; else ys=0.0; end 
s=s+(kc/ti)*(ys-y)*delta_t; 
ti=kc* (ys-y) +s+kc*td* 

((wd*ys-y)-(wd*ysb-yb))/delta_t; 
ysb=ys; yb=y; % one sampling before 
9_array(i)=u; 
for j = 1:999 
h_u (j)=h_u ; 

h_u(10 0 0)=u; 


function 

[dx_dt]-g_p;d_antiaer1va five1 
(y,x,u) 

A= [ 0 0 -l.t'§,0 -3; 01.-3] ; 

B= [ 1 -0.3 0.0]'; 
dx_dt=A*x+B*u; 


command window 


» pid_antiderivativel 


dx_dt=g_pid_antideri , yativel 
(y,x,h_u(1000-n_theta)); 
x=x+dx_dt*delta_t; 
y=C*x; 

t.-t-de] La_t; 
end 

figure (1) ; 

plot(t_array,ys_array,t_array,y_array) 
legend('y_{s](t)','y(t)'); 
figure (2) ; plot (t_array, u_array) ; 


noise-suppressing PID controller can be used: 


Gc{s) = 


«{s) 


y* (s)-y(s) 


k c TdS 

1 + az d s 


(4.88) 


,(k ) = k c (y s (k) — y(k)) proportional part 


(4.89) 
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- (y s (k) — y(k')')At integral part 


<{lc) _ fcla h(*)-X*))-fa(*-i)-K*-.)) (4 91) 

«d(A:) = u d [k - 1) + (w^ f (A t - 1) - Wd(A: - 1)) derivative part (4.92) 

u(k) = up(k) + Ui(k) + u d (k) (4.93) 

Equation (4.92) can be derived by applying the Euler method to u d (s) = wjf (s)/(aT d s + 1), 
and equivalently du d (t)/dt+u d (t)/(m d ) = uf(t)/(cn d ) in a straightforward manner. Usually, 
a ranges from 0.05 to 0.25. Better robustness to noise is obtained for a bigger a value, but the 
control performance degrades more as the a value increases. 
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Table 4.12 MATLAB code to simulate a closed-loop control system with a two-degree-of-freedom 
PID controller. 

pid_tdofl.m I g_pid_tdof1.m 



u_array(i)-u; 
for j=l: 999 
h_u(j1=h_u(j +1}; 


h_u(1000)=u; 

dx_dt=g_pid_tdof1(y,x,h_u(1000-n_theta)); 
x-x-dx_ct*de! La_t; y=C*x; 
t=t+delta_t; 
end 

figure (1) ; 

plot(l_a r ra y,ys_array,t_array,y_a rray); 
legend('y_{s}(t)','y(t)'); 
figure (2) ; plot (t_array, u_array) ; 
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Figure 4.14 Simulation result of Table 4.12. 


Example 4.20 

Simulate again Figure 4.4 with a = 0.24. Compare the closed-loop responses. 

Solution The MATLAB code to simulate the noise-suppressing PID controller and the 
simulation results are given in Table 4.13 and Figure 4.15. Comparing Figure 4.4 with 
Figure 4.15, the robustness to the noise is improved. 

4.4.5 Unified Structure of Proportional-Integral-Derivative Controllers 

The two-degree-of-freedom and noise-suppressing PID controllers can be integrated to the 
following unified form: 

u(s) = k c (w p y s (s) - y(j)) + ^ (y s (j) - ?(•?)) + noninteracting 

(4.94) 

= + interacting (4.95) 
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Table 4.13 MATLAB code to simulate a closed-loop control system with a noise-suppressing 
PID controller. 


pid_nsl.m 

g_pid_nsl.m 

clear; 

fur.cri.Qn 

t=0.0; t_final”2b . 0; 

[dx_dt]=g_pid_nsl 

x=[0 00]'; y=0.0; yb=0.0; ys=0.0; 

(y,x,u) 

ysb=0.0; ud=0.0; 

A= [0 0 -1|''A;0 -3; 0 1.-3] ; 

delta_t=0.01;n=round(t_final/delta_t); 

B=[l -0.3 0.0] '; 

#s[0 0 1] ; theta=0.2; % time delay 

dx_dt=A*x+B*u; 

h_u=zeros(1,1000); 
n_LheCa.”round (-..hera/celta • ) ; 
kc=l.5; ti«*3.0; td=0.5; 

end 

alpha”©,24; 

rand (' seed', 0).; noise=0.2 

command window 

*(rand(1,n)-0.5); 


fob i-”l: n 

» pid_nsl 

t_array (i) =t; y_array (i) 
ys_array(i)=ys; 

if(t>l) ys=1.0; elseys=0.0; end 
s=s+(kc/ti)*(ys-y)*delta_t; 
ud0=kc*td* ( (ys-y) - (ysb-yb) ) /deltaip^'i; 
ud=ud+(udO-ud)*delta_t/(alpha*td); 
u=kc*(ys-y)+s+ud; 
ysb=ys; yb=y; % one sampling before 
u_array(:)”u; 
for j =1: 999 

h_u(j)=h_u{j!fl}i 

end 

h_u (10 0 0) =u; 

dx_dt=g_pid_nsl(y,x,h_u(1000-n_theta)); 
x=x+dx_dt*delta_t; y=C*x+noise(i); 
t-t-de"; La_L; 


end 

figure (1) ; 

plot(t_array,ys_array,t_array,y_array); 
legend('y_{s}(t)','y(t)'); 
figure (2) ; plot (t_array, u_array) ; 



u(s) = K(« r y M -y(s)) + tf ttMzZM + ^ ^ 

Also, it is straightforward to add the anti-windup techniques to the unified structure by 
modifying the integral part of U\(t) to incorpoarate the conditional integration or the back 
calculation. 
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Figure 4.15 Simulation result of Table 4.13. 


Problems 

4.1 Explain the PID controller and the tuning parameters. 

4.2 The upper limit and the lower limit of the control output are 20 and 4 respectively and the 
proportional gain of the PID controller is 8. Find the PB of the PID controller. 

4.3 Draw the response of a PID controller for a unit step error. Explain the effects of the 
tuning parameters on the response. 

4.4 Simulate the step setpoint change response for the SOPTD process G(s) = exp(—0.3s)/ 
(s + l) 2 controlled by a PID controller for which the tuning parameters are k c = 1.5, 
tj = 3.0, r d = 0.5. 

(a) For a sampling time of At = 0.01. 

(b) For a sampling time of At = 0.5. 

(c) For a sampling time of At = 0.01 and uniformly distributed random measurement 
noise between —0.05 and 0.05. 

(d) For a sampling time of At = 0.2 and uniformly distributed random measurement 
noise between —0.05 and 0.05. 
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4.5 Explain the roles of the three parts of a PID controller. 

4.6 Find the offset for the case that the process G(s) = exp(—0.1 ,v)(—0.2.y + 1 )/(s 2 + 3s + 1) 
controlled by the following controllers for an unit step setpoint change: 

(a) P controller G c (s) = 1.5 . - 

(b) PI controller G c (s) = 1.5 + 

(c) PD controller G c (s) = 1.5 + 1.5 x 0.55 

(d) PID controller G c (s) = 1.5 + ^ ^ + 1.5 x 0.5 s 

4.7 Find the offset for the case that the process G(s ) = exp(—0.2 s)/s(s +1) controlled by the 
following controllers with a unit step setpoint change: 


(a) P controller G c (s ) =1.0 . „ 

(b) PI controller G c (s) = 1.0 H-— 

5 . 0 ^ 

(c) PD controller G c (s) = 1.0 + 1.0 x 0.55 

(d) PID controller G c (s) = 1.5+^+ 1.0 x 0.55 

4.8 Find the I part (k c | 0 (y s (rj —y(r)) dr jx x ) of a PID controller at steady state for the case that 
the following processes are controlled by a PID controller with a unit step setpoint change: 


(a) 

G(5) 

(b) 

G(5) 

(c) 

G(5) 

(d) 

G(5) 

(e) 

G(5) 

(f) 

G(5) 


3 

5+1 

3exp( — 0.55) 

5+1 

3(0.15+ l)(-0.l5+l) 
(5+J) 5 

(5 + 3)fexp(-0.l5) 

(5 + 2) 2 

10 

5 ( 5^|) 3 

(— 5 + l)exp( — 0.55) 


4.9 Explain the integral windup phenomenon of a PID controller. 

4.10 Simulate the closed-loop control system of which the process is G(s) = 2.0 exp(—0.35)/ 
(2.55 2 + 5.05 + 2) and the controller is a PID controller with k c = 3.38, x t = 2.60 and 
r d = 0.54. The setpoint changes from 0 to 1 at t = 1.0. Also, discuss the effects of the anti¬ 
windup techniques. 


(a) No limits to the range of the control output. 

(b) M max =1.2 and u miD = —1.2, no anti-windup technique. 

(c) Mniax = 1.2 and w min = —1.2, conditional integration technique. 

(d) M max =1.2 and u miD = —1.2, back-calculation technique. 
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4.11 Find the noninteracting PID controller and the parallel PID controller equivalent to the 
interacting PID controller G c (s) = 1.5[1 + (1/10.s')](1 + 2.55). 

4.12 Find the interacting PID controller and the parallel PID controller equivalent to the 
noninteracting PID controller G c (s) = 1.5 + (1/1 Ov) + 2.5 s. 

4.13 Simulate the closed-loop control system of which the process is G(s ) = 2.0 exp(—().3,s)/ 
(2.5s 2 + 5.0s + 2.0) and the controller is a noninteracting PID controller with k c = 3.38, 
ii = 2.60 and i d = 0.54. The setpoint changes from 0 to 1 at t = 1.0. Also, discuss the 
effects of the tuning parameters. 

(a) Two-degree-of-freedom PID controller with w v = 1.0 and w d = 1.0. 

(b) Two-degree-of-freedom PID controller with w p = 1.0 and w d = 0.0. 

(c) Two-degree-of-freedom PID controller with w v = 0.7 and iv d = 0.0. 

4.14 Simulate Problem 4.13 with measurement noise between —0.05 and 0.05 and noise¬ 

suppressing PID controller. 

4.15 Apply the following controllers to the virtual process of Process 5 (refer to the Appendix 
for details) with the scan time of 0.2 and obtain the unit step setpoint change response: 

(a) Noninteracting PID controller with k c = 1.81, ii = 16.3, i d = 5.90, At = 0.8, M max 

(b) Noninteracting PID controller with k c = 1.81, Ti= 16.3, T d = 5.90, At = 0.8, w max 

2.2, w min = 0.0. 

(c) Noninteracting PID controller with A: c =1.81, tj = 16.3, T d = 5.90, At = 0.8, 
conditional integration, u max = 2.2, w min = 0.0. 

(d) Noninteracting PID controller with k c = 1.81, Ti= 16.3, r d = 5.90, At = 0.2, u max 

(e) Noninteracting PID controller with k c = 1.81, ij = 16.3, r d = 5.90, At = 0.2, noise¬ 
suppressing PID controller, i/ max = °°, u min = —°o. 
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Proportional-Integral-Derivative 
Controller Tuning 


The tuning parameters of the PID controller should be set with in-depth consideration of the 
process dynamics. Otherwise, acceptable control performances cannot be achieved. Poor 
tuning parameters would result in very sluggish or unstable responses. In this chapter, simple 
process identification methods are introduced to obtain the process model in the form of the 
frequency response or low order plus time delay. Also, various tuning methods are discussed to 
demonstrate how to estimate the tuning parameters of the PID controller on the basis of the 
process model. 

5.1 Trial-and-Error Tuning 

Trial-and-error tuning is used to determine the tuning parameters of a PID controller by 
inspecting the dynamic behavior of the controlled process output. It is very important to 
understand the effects of the tuning parameters on the behavior of the process output for 
successful trial-and-error tuning. The PID controller usually shows the following dynamic 
behaviors with respect to the tuning parameters for the step setpoint change. 

• Behavior 1. For a step setpoint change, if the process output shows a big oscillation, as shown 
in Figure 5.1, then the proportional gain k c is too large. Here, the oscillation is centered on the 
setpoint. 

• Behavior 2. For a step setpoint change, if the controlled process output shows an overdamped 
response, as shown in Figure 5.2, then the proportional gain k c of the PID controller is too 
small. 

• Behavior 3. For a positive step setpoint change, if the process output oscillates and the 
process output stays above the setpoint longer than under the setpoint, as shown in Figure 5.3, 
then the integral time tj is too small (that is, the integral action is too strong). 

• Behavior 4. For a positive step setpoint change, if the process output oscillates and the 
process output stays under the setpoint longer than above the setpoint, as shown in Figure 5.4, 
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then the integral time Ti is too large (that is, the integral action is too weak). For open-loop 
stable processes, y s /k = (k c /x{) (y s (f) — y{t)) d t is valid if the offset is zero, where k, >> s 
and y denote the static gain, the step setpoint and the process output respectively. This means 
that the amount of the integral part of the PID controller is fixed on y s /k at steady state. So, if 
the integral amount from the starting point to the rise time is bigger than yjk due to a small Ti 
value, then the integral term will be reduced to y s /k by allowing the process output to stay 
above the setpoint longer than under the setpoint, as shown in Figure 5.3. If the integral 
amount from the starting point to the first peak is much smaller than y s /k due to a large Ti 
value, then the integral term will be accumulated to y s /k by allowing the process output to 
stay under the setpoint longer than above the setpoint, as shown in Figure 5.4. 

Behavior 5. For a step setpoint change, if the process output shows a high-frequency 
oscillation (many peaks) from the start to the steady state, as shown in Figure 5.5, then the 
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Figure 5.4 Typical closed-loop response for too large an integral time with a proper proportional gain 
and derivative time. 
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Figure 5.5 Typical closed-loop response for too large a derivative time. 
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derivative time r d is too large. This phenomenon is due to the amplification of a high- 
frequency signal by the strong derivative part. 

Now, the operator can tune the PID controller in the trial-and-error manner by adjusting the 
tuning parameters in the direction of removing the above-mentioned five dynamic behaviors. 
The final important thing to be kept in mind for successful trial-and-error tuning is to sustain the 
proportional gain as large as possible. The closed-loop dynamics tend to become slower and 
slower during trial-and-error tuning if the focus is on removing the five dynamic behaviors 
without trying to sustain a large proportional gain. 

5.2 Simple Process Identification Methods 

Because the parameters of the PID controller should be tuned on the basis of the process 
dynamics, the process model should first be identified for the tuning. So, simple process 
identification methods, such as the continuous-cycling method, the PRC method and the 
frequency test are introduced in this section before moving to various tuning methods. 

5.2.1 Continuous-Cycling Method 

The continuous-cycling method is used to estimate the ultimate frequency and the ultimate gain 
of the process. Consider the following control system with a proportional (P) controller. 

In the continuous-cycling method, first, the P controller should be implemented as shown in 
Figure 5.6. Second, the control engineer increases the controller gain and simultaneously 
changes the setpoint. If the process output diverges, then the engineer reduces the controller 
gain and vice versa. This procedure repeats until the process output oscillates continuously, as 
shown in Figure 5.7. Then, the proportional gain of the P controller after 60 s is the ultimate gain 
of the process. The ultimate period of the process is the period of the continuous-cycling. 



Figure 5.6 Control system with a proportional controller. 

The procedure of this method is simple and has been accepted by control engineers. 
However, it is a trial-and-error approach, resulting in a long identification time. Also, it is 
undesirable to push the control system to the marginally stable zone from the safety point of 
view. 

In real industrial plants, the engineer can usually set the upper and lower limits on the control 
output, which plays an important role in preventing divergences. The continuous-cycling test 
can be performed in a safer way by appropriately setting the upper and lower limits to the 
control output, as shown in Figure 5.8. 

As shown in Figure 5.8, the magnitude of the oscillation of the process output is limited by 
setting the upper/lower limit on the control output. If the proportional gain is smaller than 
the ultimate gain, then the control output converges. If the proportional gain is bigger than the 
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ultimate gain, then at least one side of the oscillation of the control output is saturated to the 
upper or lower limit. Meanwhile, one side of the oscillation contacts slightly with one of the 
limits (but not saturated) if the proportional gain is the same as the ultimate gain. 

Let us justify why the proportional gain and the period of the continuous-cycling in 
Figure 5.7 are the ultimate gain and the ultimate period respectively. In Figure 5.7, the process 
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Figure 5.8 Continuous-cycling test with upper and lower limits on the control output. 

outputis a sine signal likey(i) = — c sin(tui) + d since the input/output signals of linear systems 
in continuous cycling are always sine signals. Then, the control output is u(t) = k c c sin 
(cot ) — k c d + k c y s from u(t) = k c (y s — y(t)). The signs of the two sine signals u(t ) and y(t) 
are opposite. So, the period of continuous cycling is the ultimate period (equivalently, 
/G(ja>) = —tc). Also, the ultimate amplitude ratio of IG(icu)l is c!k c c= l/k c and the ultimate 
gain is k c (equivalently, k c = l/IG(iw)l). 
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5 . 2.2 Process Reaction Curve Method and Frequency Test 

The PRC method and the frequency test method were introduced in Chapter 3. They provide the 
FOPTD model and the frequency response data (ultimate frequency and ultimate gain). For 
details, refer to Chapter 3. 


5.2.3 Advanced Process Identification Methods 

Advanced process identification methods are summarized in Part Three. They can provide 
complex high-order plus time-delay models and complex frequency response models. For 
details, refer to Part Three. 

If the process model is obtained with the process identification methods, then the parameters 
of the PID controller are ready to be tuned. 


5.3 Ziegler-Nichols Tuning Rule 

The Ziegler-Nichols (ZN) tuning rule (Ziegler and Nichols, 1942) uses the ultimate gain and 
the ultimate period of the process. Table 5.1 provides the tuning parameters of the PID 
controller for the given ultimate data set of the process. 


Table 5.1 ZN tuning rule. 


Controller 


Tuning parameters" 


k c 

r, 

r d 

P 

k u /2.0 

— 

— 

PI 

kJ22 

pj\.2 

— 

PID 

kjl.l 

Pu/2.0 

pJS.O 


a k u and p u denote the ultimate gain and the ultimate period of the process respectively. 


The tuning rule is very simple and needs only the ultimate information, which can be 
estimated easily by simple identification methods, such as the continuous-cycling method and 
relay feedback identification method (which will be introduced in Part Three). The ZN tuning 
rule shows acceptable control performances for the usual processes. However, because the ZN 
tuning rule uses only the ultimate data of the process, it shows poor control performances for 
underdamped or large time-delay processes, because the process has unusual frequency 
response characteristics in the low-frequency region. 

Example 5.1 

Obtain the tuning parameters of a PID controller if the ultimate gain and the ultimate frequency 
are k u = 0.2 and oj l1 = 0.9 respectively. 

Solution w u = 0.9 means that the ultimate period is p u = 2tt/0.9. So, the tuning parameters of 
k c = 0.2/1.7, Tj = tt/0.9 and r d = tt/(0.9 x 4) are obtained from Table 5.1. 
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Example 5.2 

Obtain the tuning parameters of a PI and a PID controller for the process of which the transfer 
function is G(s ) = l/(s + l) 3 . 

Solution The ultimate frequency and the ultimate gain can be estimated if the transfer 
function oftheprocess is given. Because G(il.732)= l/(il.732 + l) 3 = —0.125 + i0.000,the 
ultimate frequency is w u = 1.732 (equivalently, p u = 2tt/ 1.732) and the ultimate gain is k u = 
1/0.125. For the detailed descriptions, refer to Chapter 3. So, the tuning parameters of k c = 
1/(0.125 x 2.2) and t-, = 2tt/(1.732 x 1.2) are obtained from Table 5.1 for the PI controller. In a 
similar way, the tuning parameters of the PID controller can be obtained. Table 5.2 and 
Figure 5.9 show the MATLAB code for the simulations and the simulation results respectively. 
In Figure 5.9a, the setpoint is changed at / = 1 and a step input disturbance of magnitude equal 
to 1 is entered at t= 1 in Figure 5.9b. Here, the step input disturbance is the step-type 
disturbance added to the process input. 


Table 5.2 MATLAB code to simulate a PID control system tuned by the ZN tuning rule. 


zn_model_ex2.m 

g_zn_model_ex2.m 

clear; 

function [G]=g_zn_model_ex2(w) 

w=0.0; delta_w=0.05; 

s=i*w; 

while (1) % search boundary in which wu 

G=l/(s+1) A 3; 

w=w+delta_w; g=g_zn_model_ex2(w); 
if(imag(g)>0.0) break; end 
end 

wl=w-delta_w; w2=w; % w 1< wu < w2 


While (1) % find wu using the bisechtlJtii 

g_pid_zn_ex2,m 

method 

function [next_x y] =g_pid_zn_ex2 

w=(wl+w2)/2; 

(x,delt,u) 

gl=g_zn_model_ex2(wl); 

subdelt=delt/5; 

g=g_zn_model_ex2(w); 

«M$&md (delt/subdelt); 

’*4f(imag(g)*imag(gl)>0.0) wl=w; else 

A= [0 0 -1; 1 0 -3; 0 1 -3] ; 

w2=w; end 

B=[1; 0; 0 Jr 

if(abs(imag(g))<0.000001) break; 

C=[0 0 1] ; delay=0.0; 

end 

delay_k=round(delay/delt) ; 

end 

for i=l: n 

wu=w; % ultimate frequency wu is found 

dx=A*x+B*u(500-delay_k); 

pu=2*pi/wu; 

x=x+dx*subdeltjf 

ku=l/abs(g_zn_model_ex2(wu)); 

end 

p_kcd=ku/2.0; 

next_x=x; y=C*x; 

pi_kcd=ku/2,2; pi_tid=pu/l.2; 
pid_kcd=ku/l.7; pid_tid=pu/2.0; 
pid_tdd=pu/8.0; 

fprintf (' P: ked=%6.3f \n' , p_kcd) ; 

fprintf('PI: kcd=%6.3f, tid=%6.3f 

\n' , pi_kcd, pi_tid) ; 

fprintf('PID: kcdd=%6.3f, 

tid=%6.3f, tdd=%6.3f 

\n',pid_kcd,pid_tid,pid_tdd); 
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Table 5.2 ( Continued) 


co.Tirr.and window 
» zn_model_ex2 
P: kcd= 4.000 

PI: kcd= 3.636, tid= 3.023 

PID: kcdd= 4.706, t: c> , 81 4 , tdd= 

0.453 

» pid_zn_ex2 


pid_zn_ex2.m 

kc=pid_kcd; ti=pid_tid; td=pid_tdd; 
t=0.0; t_final=15.0 ; 

x=I000]'; y-Q.0; yb=0.0; ys=0.0; ysb=0.0; dis=0.0; 
delta_t=0.02; n=round (t_final/delta_t) ; 
h_u=zeros(1,500); s=0.0; 
f o#*=l: n 

t_array(i)=t; y_array(i)=y; ys_array(i)=ys; 

if(t>l) ys=1.0; elseys=0.0; end % setpoint change simulation 
% if(t>l) dis=1.0; elsedis=0.0; end % disturbance rection 
s : r.u 1 at-i or. 

s=s+(kc/ti)*(ys-y)*delta_t; 

ti-kc* (ys-y) +s+kc*td* ( (ys-y) - (ysb-yb) ) /dell®£_t; 
ysb=ys; yb=y; % one sampling before 
u_array(iJ^OT 
for j=l: 499 

h_u ( j) ( ; -1) ; 

end 

h_u(500)=u+dis; 

[x y]=g_pid_zn_ex2(x,delta_t,h_u); 
t=t+delta_t; 
end 

figure(l) ; plot (t_array, ys_array^’t^airay, y_array) ; legend (' y_{ s } 
(tf;', 'y(t) ') ; 

figure (2) ; plot (t_array, u_array) ; 


5.4 Internal Model Control Tuning Rule 


The objective of the internal model control (IMC) tuning rule (Morari and Zafiriou, 1989) is to 
match the control performance of the PID controller with that of the IMC controller. It needs the 
following FOPTD model: 


G m(s) = 


A:exp(— 9s) 

TJ , + 1 


(5.1) 


where k, x and 9 denote the static gain, the time constant and the time delay respectively. The 
FOPTD model can approximate the usual overdamped processes. The model can be obtained 
by various process identification methods. Refer to Section 5.2 for the detailed descriptions. 
The IMC tuning rule determines the tuning parameters using the formulas in Table 5.3, where 
X > 0.250 for the PID controller and X > 1.70 for the PI controller. If a smaller value of X is 
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chosen, then a faster closed-loop response is obtained. However, too small a A value results in an 
oscillatory or unstable closed-loop response. If the model (5.1) is accurate, then the tuning 
parameters with A = 0.250 show good control performances and robustness for the step setpoint 
change. 

The IMC tuning rule shows excellent control performances for a step setpoint change. 
Meanwhile, it shows sluggish control performances for step input disturbance rejection. Here, 
the step input disturbance is the step-type disturbance added to the process input. 

The FOPTD model has a structural limitation in representing underdamped or high-order 
processes. Thus, the IMC tuning rule based on the FOPTD model shows poor control 
performances for unusual processes, such as underdamped or high-order processes. 

Example 5.3 

Obtain the tuning parameters of a PID controller for the process of which the transfer function is 
G(s)= 1.5exp(—0.3 s)/(1.2j + 1) using the IMC tuning rule. And simulate the closed-loop 
response for the step setpoint change and the step input disturbance rejection. 

Solution A = 0.25 x 0.3 is chosen and then the tuning parameters k c = ( 2 x 1.2 + 0.3)/ 
[2(0.25 x 0.3 + 0.3) x 1.5],^= 1.2 + 0.3/2 and r d = (1.2 x 0.3)/(2 x 1.2 + 0.3) are obtained 
from Table 5.3. Table 5.4 and Figure 5.10 are the MATLAB code for the simulation and the 
simulation results. The step setpoint is changed at / = 1 in Figure 5.10a and the step input 
disturbance of magnitude equal to 1 enters at t = 1 in Figure 5.10b. It is clear that the control 
action for the step input disturbance rejection is more sluggish than that for the step setpoint 
change. 

5.5 Integral of the Time-Weighted Absolute Value of the Error Tuning 
Rule for a First-Order Plus Time-Delay Model (ITAE-1) 

The integral of the time-weighted absolute value of the error tuning rule for an FOPTD model 
(ITAE-1) tuning rule provides the tuning parameters minimizing the following integral of the 
time-weighted absolute value of the error (ITAE). 

ITAE = f /|y s (f) — y(/)| d/ (5.2) 

Jo 

Lopez et al. (1967) provides the equations in Table 5.5 to approximate the optimal tuning 
parameters minimizing (5.2). 

The parameters tuned by the ITAE-1-disturbance method for the step input disturbance 
rejection are almost the same as the optimal tuning parameters. But the ITAE-1 setpoint shows a 
sluggish control action compared with that of the optimal tuning parameters for the step 
setpoint change. 

Example 5.4 

Obtain the tuning parameters of a PID controller for the process of which the transfer function is 
G(s) =1.5 exp(—0.3.sj/( l ,2s + 1) using the ITAE-1 tuning rule. Also, simulate the closed-loop 
response for the step setpoint change and the step input disturbance rejection. 



162 


Process Identification and PID Control 


Table 5.4 MATLAB code to simulate a PID control system tuned by the IMC tuning rule. 


imc_tune_exl.m 
k=1.5|’fc=l,2; th=0.3; 
r=l.7*th; 

p:_<cs-(2*t+th)/2/r/k; 
pi_tis=t+th/2 ; 

r=0.25*th; 

pid_kcs= (2* L-rtH) /2/ ( r-Lh) /k; 
p: d_Lis-t-ih/2; 
pid_tds=t*th/(2*t+th) ; 
fprintf('PI: kcs=%6.3f, tis=%6.3f 
\n',pi_kcs,pi_tis); 

PI D: kcds=% 6.3%. 

tis=%6.3f, tds=%6.3f\n',pid_kcs, 
pid_tis,pid_tds) ; 


g_pid_imc_exl.m 

function [next_x y] =g_pid_imc_exl 
(x,delt,u) 
subde1t=de11 / 5 ; 
n=rotind (delt/subdelt) ; 

A=[-1.0/1.2 ] ; B=[1.5/1.2] ; C=[l] ; 
delay=0.3; 

delay_k=round(delay/delt); 
for i=l: n 

dx=A*x+B*u(500-delay_k); 
x=x+dx*subdelt; 

end 

next_x=x; y=C*x; 


command window 
» £|pS§_tune_exl 
PI: kcs= 1.765, tis= 1.3fff 
PID: kcds= 2.400, tis=1.350, 
tds= 0.133 
» p: ci_iir.c_ex'. 


pid_imc_exl.m 

kc=pid_kcs; ti=pid_tis; td=pid_tds; 

t=0.0; t_final=10.0; x=[0 ]'; y=0:,0; yb=0.0; ys=0.0; ysb=0.0; dis=0.0; 
delta_t=0.02; n=round(t_final/delta_t); h_u=zeros(1,500); s-0,0; 
for i=l: n 

t_array(i)=t; y_array(i)=y; ys_array(i)=ys; 

, JLf (t>l) ys=l. 0; else ys=0.0; end % setp'ojltiS'change simul^ftfeit 
% if (t>l) dis=l. 0; else dis=0.0; end % disturbance rection 
simulation s=s+ (kc/ti) * (ys-y) *delta_t; 

11 =kc*(ys-y)+s+kc*td*((ys-y)-(ysb-yb))/delta_t; 
ysb=ys; yb=y; % one sampling before 
'.'|i_array (i) =u; 

for j=l: 4 99 h_u $|*h_u0+1) ; end 

h_u(500)=u+dis; [x y]=g_pid_imc_exl(x,delta_t,h_u)/ 
t=t+delta_t; 
end 

figure(3); plot(t_array,ys_array,t_array,y_array); 
legend('y_{s}(t)','y(t)'); 
figure (2) ; plot (t_array, u_array) ; 


Solution k c = 2.090, T; = 1.580 and i d = 0.102 for the step setpoint change and k c = 3.362, 
tj = 0.512 and i d = 0.115 for the step input disturbance are obtained from Table 5.5. Table 5.6 
and Figure 5.11 show the MATLAB code and the simulation results respectively. The step 
setpoint is changed at t = 1 in Figure 5.11a and the step input disturbance of magnitude equal to 
1 enters at t = 1 in Figure 5.11b. The step input disturbance is a step-type disturbance added to 
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(a) 



0 2 4 6 8 10 


(b) 

Figure 5.10 Control performances of a PID controller designed by the IMC tuning rule: (a) setpoint 
change; (b) disturbance rejection. 


Table 5.5 ITAE-1 tuning rule for an FOPTD model. 


Controller 


Tuning parameters 


kk c 

Z/Zi 

z A /z 

Pi-setpoint 

O.586(0/t)-°' 916 

1.030-0.165 (d/z) 

— 

PID-setpoint 

O.965(0/t) -0 ' 850 

0.796-0. 1465(0/t) 

O.3O8(0/t)°- 929 

Pi-disturbance 

O.859(0/t) -0 ' 977 

0.674(e/T)“°' 680 

— 

PID-disturbance 

1.357(0/t) -0 ' 947 

0.842(6>/t) —0-738 

O.381(0/t)°" 5 
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Table 5.6 MATLAB code to simulate a PID control system tuned by the ITAE-1 tuning rule. 

itael_talne_exl.r. 

clear; 

k=l.5; t=1.2i fch=0.3; 

pi_kes~0.586* (th/t) A (-0.916) /k; . 030-0.165*tfc/.%$ j 

pid_kcs=0.965*(th/t) A (-0.850)/k; pid_tis=t/(0.796-0.1465*th/t); 
pid_tds=t*0.308*(th/t) A 0.929; 

pi_kcd=0.859*(th/t) A (-0.977)/k; pi_tid=t/(0.674*(th/t) A (-0.680)); 
pid_kcd=l.357*(th/t) A (-0.94 7) /k; pid_tid=t/(0.842*(th/1) A (-C . 738)) ; 
pid_tdd=i/*iO .381* (th/t) A 0.995; 

fpflatf ( PI-setpoint: kcs=%6.3f, tis=%6.3f \n' , pi_kcs, pi_tis) ; 
fprintf('PID-setpoint: kcds=%6.3f, tis=%6.3f, tds=%6.3f\n', pid_kcs, 
pid_tis,pid_tds); 

fprintf (' Pi-disturbance : kcd=%6.3f, tid=%6.3f \n' , pi_kcd, pi_tid) ; 
fpilpltf('PID-disturbance: kcdd=%6.3f, tid=%6.3f, tdd=%6.3f 
\n' , pid_kcd,pid_tid,pid_tdd); 


pid_itael_exl.m 

kc=pid_kcs; ti=pid_tis; td=pid_tds; % setpoint change simulation 
%kc=pid_kcd; ti=pid_tid; td=pid_tdd; % disturbance rection simulation 
t=0.0; t_final=10.0; x=[0 ]'; y=0.0; yb=0.0; ys=0.0; ysb=0.0; dis«0.0; 
delta_t=0.02; n=round (t_final/del6aLt) ; h_u=zeros (1,500) ; s=0.0; 
for i=l: n 

t_array (i) =t; y_array (i) “y,; ys_array (i) =ys; 
if (t>l) ys-l.O; elseys=0.0; end % setpoint change simulation 
% yt|S(t>l) dis=1.0; else dis=0.0; end % disturbance retstidh; 
simulation 

s=s+(kc/ti)*(ys-y)*delta_t; 

tl=kc*(ys-y)+s+kc*td*((ys-y)-(ysb-yb))/delta_t; 
ysb=ys; yb=y; % one sampling before 
u_array(i| ~u; 

fob j =1: 4 99 h_u (j + 1) ; end 

h_u(500)=u+dis; [x y]=g_pid_itael_exl(x,delta^fc,h_u); 
t-t-delLa_L; 

figure(l); hold on; plot(t_array,ys_array,t_array,y_array); 
legend('y_{s}(t)',' y(t)'); 
figure (2) ; plot (t_array, U_array) ; 


g_pid_itael_exl.m 
function [next_x y] = 

command window 

g_pid_itael_exl(x,delt,u) 

» itael_tune_exl 

subde1t=deIt/ 5r 

Pi-setpoint: kcs=l.,/391. 

n=round(delt/subdelt); 

%&= 1.214 

[-1.0/1.2]; B=[1.5/1.2]; C=[l]; 

P'D-serpoin-t: kcds= 2.090, 

delay=0.3; 

tis- 1 .580, tds- 0.102 

delay_k=round(delay/delt); 

Pi-disturbance: kcd=2.219, 

for i=l: n 

tid= 0.694 

dx=A*x+B*u(500-delay_k); 

PID-disturbance: kcdd= 3.362, 

x=x+dx* subdelt; 

end 

tid= 0.512, tdd= 0.115 
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(b) 

Figure 5.11 Control performances of a PID controller designed by the ITAE-1 tuning rule: (a) setpoint 
change; (h) disturbance rejection. 

the process input. The dynamic behaviors of the step input disturbance and the step output 
disturbance are totally different. Usually, the PID controller tuned for the step input disturbance 
shows more aggressive control action compared with the PID controller tuned for the step 
setpoint change. So, the ITAE-l-setpoint shows a too sluggish control action for the step input 
disturbance and the ITAE-1-disturbance shows a too aggressive control action for the step 
setpoint change. 

Figure 5.12 compares the control performances of the tuning rules for the FOPTD model. 
Here, the process is G(s)= 1.5exp(—0.3.sj/(l ,2s + 1). As shown in Figure 5.12, the IMC 
tuning rule and the ITAE-1-disturbance show superior control performances for the setpoint 
change and the step input disturbance rejection problems respectively. Contrarily, the IMC 
tuning rule shows a sluggish response for the step input disturbance. Also, the ZN tuning rule 
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y(f)-IMC 

y(f)-ZN 

y(t)-ITAE1-setpoint 



(b) 

Figure 5.12 Control performances of PID controllers tuned by ZN, ITAE-1 and IMC tuning rules: 
(a) step setpoint change; (b) step input disturbance rejection. 


shows a poor control performance for the step setpoint change. The IMC tuning rule is 
recommended to tune the PID controller for the step setpoint change problem and the ITAE-1 - 
disturbance is recommended for the step input disturbance rejection problem. 

5.6 Integral of the Time-Weighted Absolute Value of the Error Tuning 
Rule for a Second-Order Plus Time-Delay Model (ITAE-2) 

The SOPTD model of (5.3) can describe the dynamics of high-order or underdamped processes 
with fairly good accuracy. So, it is clear that the tuning rules on the basis of the SOPTD model 
are potentially much better than those on the basis of the FOPTD model. 
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Gm(s) = 


/texp( — Os) 


(5.3) 


Sung et al. (1996) proposed the ITAE-2 tuning rule for an SOPTD model. They obtained the 
optimal tuning parameters by solving the optimization problems of (5.2) for the extensive cases 
of the SOPTD model. And they fitted the optimal data sets obtained as shown in Table 5.7. 
ITAE-2 is applicable to all the cases of 0.3 < £ < 5.0 and 0.05 < 0/x < 2.0. ITAE-2 provides 
almost the same control performances as those of the optimal tuning for both the step setpoint 
change and the step input disturbance rejection problems. 


Table 5.7 ITAE-2 tuning rule for an SOPTD model. 


j /ax -0.983] 

ITAE-2-setpoint kk c = - 0.04 + 0.333 + 0.949 ( -) ( < 0.9 

/q\ /q\ -0.832 

kk c = -0.544 + 0.3081 -) +1.4081 -j £, £>0.9 

^ = [2.055 + 0.072 01 <r, *<1.0 

-= {l.768+ 0.329 *>1.0 


— = \ 10-exp - 


0.870 


+ 2.189 


ITAE-2-disturbance kk c = -0.670 + 0.297 0) 

kk c — — 0.365 + 0.260 f— — 1.400 ) +2.189 


r 

gt* 

gp 


^ = 2.2120^ -0.31 


0.300, -<0.4 

— 0.975 + 0.9100 — 1.845^ + jl-exp[ 
x ^5.250 - 0.8800 - 2.800j |, * > 0.4 


0.150 + 0. 33O(0/t)J y 


-= - 1.900+1.5761 
x [+45 + 0.969 


-exp 


G)' 


- 0.15 + 0.939(0/-, 


HI 
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Example 5.5 

Obtain the tuning parameters of a PID controller for the process of which the transfer function is 
G(s ) =1.5 exp(—0.3,y)/(2.5.s’ 2 + 5.0 s + 2) using the ITAE-2 tuning rule. 

Solution Because G(s) =1.5 exp(—0.3,s')/(2.5.s' 2 + 5.0 s + 2) is equivalent to G(s) = 0.75 exp 
(—0.3s)/(1.118V + 2x 1.118 x 1.1185 + 1), >t c = 5.656, ^ = 2.593 and r d =0.538 for the 
step setpoint change and k c = 13.55, = 0.912 and T d = 0.409 for the step input disturbance 

change are obtained from Table 5.8. Figure 5.13 shows the control performances of the ITAE-2- 
setpoint and ITAE-2-disturbance. 


Table 5.8 MATLAB code to simulate a PID control system tuned by the ITAE-2 tuning rule. 

itae2_tune_exl.m 
k-0.75; t=l.118; d=1.118; th=0.3; 

% static gain, time constant, damplihg factor, time delay 
if (d<~0.9) 

kcs=(-0.04+(0.333+0.949*(th/t) A (-0.983))*d)/k; 
else 

kcs=(-0.544+0.308*th/f*l.408*(th/t) A (-0.832)*d)/k; 

if( (th/f)<-l„0) 

tis=(2.055+0.072*th/t)*d*t; 
else 

tis=(1.768+0.329*ubfi)*d*t; 
end 

tds=t/(1.0-exp(-(th/t) A (1.060)*d/0.870))/(5,35+1.683*(th/t) A 
(-1.090)); 
if((th/t)<0.9) 

kcd= (-0.67 0 + 0.297* (th/t) A (-2.001)-2.1 89* (th/1.) A (-0.7 66) *d) /k; 
else 

kcd=(-0.365+0.260*(th/t-1.400,pj+2.189*(th/t) A (-0.766)*d)/k; 
if((th/t)<0.4) 

tid=(2.212*(th/t) A (0.520)-0.300)*t; 
else 

tid= (-0.975 + 0.910* (th/t-1.84o). A 2+ (1-exp (-d/ (0.150 + 0.330*th/t£) ) 
(5.25-0.88* (th/t-2.8) A 2) )%/ 

tdd=t/(-1.9+1.576*(th/t) A (-0.53)+(1-exp(-d/(-0.15+0.939*(th/t) A 
1+1.121 ):)|:)*( 1.45 + 0.969* (th/t) A (-1.171) ) ) ; 
fp^iatf ('kcs=%6.3t,t. tis=%6.3f, tds=%6.3f \n', kcs, tis, tds) ; 
fpcjl^tf ('kcd=%6.3f, tid=%6.3f, tdd=%6.3f \n', kcd, tid, tdd) ; 


pid_itae2_exl.m 
kc=kcs; ti=tis; td=tds; 

%kc=kcd; ti=tid+0.05; td=tdd; 
t=0.0; t_#n.al=15.0; 

x=[0 0]'; y=0.0; yb=0.0; ys=0.0; ysb=0 


g_pid_itae2_exl.m 
function [next_x y] = 
g_pid_itae2_exl(x,delt,u) 
subdelt=delt/5; 

Of n=round (delt/subdelt) ft, 
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Table 5.8 ( Continued) 


dis=0.0; 

A=[0 -2/2.5 ; 1 -5/2’w,i.if 

delta_t=0.02; n=round(t_final/delta_t) ; 

B= [1.5/2, 5 f 0 ] ; 

h_u=zeros(1,500); s=0.0; 

C=[0 1] ; delay=0.3 ; 

for|~l:n 

delay_k=round(delay/delt) ; 

t_array(i)=t; y_array(i)=y; ys_array 

for i=l:n 

(i)=ys; 

dx=A*x+B*u(500-de- 

% setpoint change simulation 

lay_k); 

'4E(t>l) ys=1.0; elseys=0.0; end 

x=x+dx*subdelt; 

% disturbance rection simulation 

end 

dis=1.0; else dis=0.0; end 

next_x=x; y=C*x; 

s=s+(kc/ti)*(ys-y)*delta_t; 
tl=kc* (ys-y) +s+kc*td* ( (ys-y) - (ysb- 
yb) ) /delta_t; 


ysb=ys; yb=y; % one sampling before 

command window 

:|l_array(i)=u; 

» itae2_tune_exl 

for j=l : 499 

kcs= 5,656, tis=- ; |:*'593, tds= 

h_u (j ) =h_u (j+A) ; 

0.538 

end 

kcd-i 3.552, tid= 0.912, tdd= 

h_u ( 5 0 0 ) =u+dis ; 

0.409 

[x y]=g_pid_itae2_exl(x,delta_t, 
h_u) ; 

t=t+delta_t; 

end 

figure ( 3 ) ; 

plot(t_array,ys_array,t_array, y_ar- 
ray) ; 

legend (' y_{s } (t) ' , ' y (t) ' ) ;figure (2) ; 
plot(t_array,u_array) ; 

» pid_itae2_exl 


5.7 Optimal Gain Margin Tuning Rule for an Unstable Second-Order 
Plus Time-Delay Model (OGM-unstable) 


A PID controller has a structural limitation in controlling an unstable process. Thus, a PID 
controller with an internal feedback loop of the PD controller is recommended, as shown in 
Figure 5.14. For details, refer to the Section 5.8 and Chapter 7. 

In this section, the optimal gain margin tuning rule for the PD controller G c (s) = k x (\ + 
is introduced for the following unstable SOPTD model: 


GmW = 


A:exp( — 0s) 
(ts— 1)(t s s+ 1) 


(5.4) 


Kwak et al. (2000) obtained the optimal tuning parameters for extensive cases of the 
unstable SOPTD model. And they fitted the optimal data sets obtained as shown in Table 5.9. 
The OGM-unstable tuning rule is applicable to all the cases of 0 < 0 < x — t s . 
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(a) 



Figure 5.13 Control performances of PID controllers tuned by the ITAE-2 tuning rule: (a) step setpoint 
change tracking; (b) step input disturbance rejection. 

Example 5.6 

Obtain the tuning parameters of a PD controller for the process of which the transfer function is 
G(s) = 1.0 exp(—0.2.y)/(3.0 1 y — 1)0 + 1) using the OGM-unstable tuning rule. 

Solution k c = l.\62 and r d = 0.300 are obtained from Table 5.10. Figure 5.15 shows the 
control performances of the OGM-unstable tuning rule. 

5.8 Model Reduction Method for Proportional-Integral-Derivative 
Controller Tuning 

If the model is given in the form of a high-order plus time-delay model or frequency response 
data, then most PID tuning rules cannot be used. In this case, the high-order model or the 
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Figure 5.14 PID control combined with an internal feedback loop to control i 

Table 5.9 OGM-unstable tuning rule for an unstable SOPTD model. 

m unstable process. 

Controller 

Tuning parameters 


h 

T di /r 


P , _ 1 _ 

V|G m (iO||G m (C 

| 


PD , 1 

Tdi k0\ t'd\ 2 


1 ©|G m (ku u )(l + k 

di- u )HG m (o)iT-^+^Q + ^Q 



Xi = — 0.003 + 0.6482^—^ —2.2841 

©A 2622 !©’ 


- 0.9611(-) 

X 2 = 0.2446 - 1.0410(-) + 13.6723 

© ! -,6.762 2 © 3 


+ 5.1471 ^ 

X 3 = 0.1685 + 0.8289^ -9.363o( 

-) 2 + 2.9855(-) 3 


+ 7.3803 Q 4 



frequency response data should be reduced to the FOPTD model or the SOPTD model (Sung 
and Lee, 1996). In this section, the model reduction method for the stable process is discussed, 
followed by modifications to consider the effects of the zeroes and the reduction method for the 
unstable process. 


5.8.1 Model Reduction for Stable Processes 

Assume the use of a high-order model for which the transfer function is G h ; gh (,s’) and there is a 
need to reduce it to the SOPTD model: 


Ghigh(s) = 


&exp(- Os) 
: 2 s 2 + 2 t + 1 


(5.5) 


The model reduction method fits the SOPTD model to the frequency responses of the high- 
order plus time-delay model. It first estimates the gain of the reduced model to fit the zero 
frequency response data as follows: 


k = Ghigh(O) 


( 5 . 6 ) 
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Table 5.10 MATLAB code to simulate a PID control system tuned by the OGM-unstable tuning rule. 

OGM_unstable_tune_exl .Iff 

clear; 

k=1.0; t=3.0; ts=1.0; th=0.2; % static gain, time constant(unstable), time 
constant (stable) -|Jme delay 
w=0.0; delta_w=0.05; 

while (1) % search boundary la which wu exists 
w=w+delta_w; g=g_OGM_unstable_exl(w,0); 
if(imag(g)>0.0) break; end 
end 

wl=w-delta_w; w2=w; % w 1< wu < w2 

while (1) % find wu using the bisection method 

w=(wl+w2)/2; gl=g_OGM_unstable_exl(wl,0); g=g_OGM_unstable_exl(w,0); 
if(imag(g)*imag(gl)>0.0) wl=w; else w2=w; end 
if(abs(imag(g))<0.00000001) break; end 
end 

wu=w; % ufltfittate:frequency wu is found 
gu=g_OGM_unstable_exl (wu. O') ; 

P_ki=l/sqrt(abs(gu)*abs(k)); 

% tuning parameter for P controller 


Xl=-0.003+0.6482*(ts/t)-2.2841*(ts/t) A 2+2.6221 *(Ls/t) A 3-C.9611 
*(ts/t) A 4; 

X2=0.2446-1.0410*(ts/t)+13.6723*(ts/t) A 2-16.7622*(ts/t) A 3+3.1471* 
(ts/t) A 4; 

X3=0.1685+0.8289*(ts/t)-9.3630*(ts/t) A 2+2.9855*(ts/t) A 3+7.3803 
*(ts/t) A 4; 

PD_tdi=t*(X1+X2*(th/t)+X3* (feh/t) A 2); % td £pr P3 controlier 
w= 0.0; delta_w= 0.0% 

while (1) % search boundary in which wu exists 
w=w+delta_w; g=g_OGM_unstable_exl(w,PD_tdi); 

1 ;p.f (imag (g) >0.0) break; end 
end 

wl=w-delta_w; w2=w; % w 1< wu < w2 

while (1) % find wu using the bisection method 

w=(wl+w2)/2; gl=g_OGM_unstable_exl(wl,PD_tdi); g=g_OGM_unstable_exl 
(w,PD_tdi); 

if(imag(g)*imag(gl) >0.0) wl=w; else w2=w; end 
.if(abs(imag(g))<0.00000001) break; end 
end 

wu=w; I ultimate frequency wu is found 
gu=g_OGM_unstable_exl(wu,PD_tdi); 
gO=g_OGM_unstable_exl(0,PD_tdi); 

PD_ki=l/sqrt (abs (gu) *abs (gO) ) ; %:■ k,i far PD controller 
P: P_ki=%6.3f \n' , P_kii ; 

fprintf('PD: PD_ki=%6.3f, PD_tdi=%6.3f \n' , PD_ki, PD_tdi); 
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Table 5.10 ( Continued ) 


T>id_OGM_unstable_exl .m 
% OGM_unstable run Lr.q parameters 
kc=PD_ki; td=PD_tdi; 

% OGM_unstable tuning parameters 

%kc=P_ki; td=0; 

t=0.0; t_fina:-i0.0; 

x= [0 0] ' ; y=0.0; yb=0.0; ys=O.0; 

ysb=0.0; dis=0.0; 

delta_t=0.01; n=round (t_final/del- 
ta_t); 

h_u=zeros (1,500); 
f or i- : : r. 

t_array(i) =t; y_array(i)=y; 
ys_array(i)=ys ; 

% setpoint change simulation 
if(t>l) ys=1.0; elseys=0.0; end 
% disturbance rectif8j. : simula.tion 
% ’i£(t>l) dis=l. 0; elsedis=0.0; 
end 

ti=kc* (ys-y) +kc*td* ( (ys-y) - (ysb- 
yb))/delta_t; 

ysb=ys; yb=y; % one sampling before 

■U_array ( i ) =u'j 

for j=l:499 

h_u (;;.)-h_u (j+1) ; 

h_u(5 0 0)=u+dis; 

jx y]=g_pid_OGM_unstable_exl(x, 
delta_t,h_u); 

t—t+delta_t; 
end 

figure (3) ; 

plot(t_array,ys_array,t_array, 
y_array); 

legend('y_{s}(t)','y(t)'); 
figure (2) ; plot (t_array, u_array) ; 


g_OGM_unstable_exl.m 
fatfCtion [G] =g_OGM_unstable_exl 
(w, tdi) 

G=exp(-0 ,2*s) * (l+tdi*s)/(3*s-l)/ 

(s+1); 

end 


g_pid_OGM_un s tab1e_e xl,m 
func-txob [next_x y] = 
g_pid_OGM_unstable_exl(x,delt,u) 
subdelt=delt/5; 
n=round(delt/subdelt); 

A=[0 1.0/3.0 ; 1.0 -2.0/3.0]; 

B=[2.0/3.0; 0] ; C=[0 1] ; 
delay=0.1; 

delay_k=round(delay/delt) ; 
for i=l: n 

dx=A*x+B*u(500-delay_k) ; 
x=x+dx*subdelt; 

end 

next_x=x; y=C*x; 
end 


command window 
» OGM_unstable_fttafi;i_exl 
P: P_ki= 3.193 

PD: PD_ki= 7.162, PD_tdi= 0.300 
» pid_OGM_unstable_exl 


It then estimates x and £ to satisfy the equality of (5.7) by solving (5.8) using the least-squares 
method. Equation (5.8) is derived from (5.7) in a straightforward manner. 


I (Thigh (iw) | 


I A:exp( — iOw) I k 

II - TV +12^| “ ^ ( 1 _ T 2 W 2 ) 2 + (2T ^ ) 2 


(5.7) 


T 4 |GMgh(K)lM + ( 4t2 ^ 2 - 2T 2 )|G high (H-)| 2 ^ 2 =k 2 - |G high (t W/ -)| 2 (5.8) 


0 < (x)\ < (02 < • • • < (Oj < 


( 5 - 9 ) 
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Figure 5.15 Control performances of a PD controller tuned by the OGM-unstable tuning rule. 

where it is recommended to choose o) n as the ultimate frequency co u of the process. If <d u is not 
available, then co„ should be chosen as the closest one to <d u . The model reduction method 
finally estimates the time delay of the SOPTD model from the following phase-angle 
equation (5.10) with respect to co m . Equation (5.11) is directly obtained from (5.10). 

/Ghigh(iwm) = L | ^2r}co = ~ 6( ° m + arctan2 (“ 1 - ^t 2 ) 

(5.10) 


— <J)(ft> m ) + arctan2(— 2£rcu m , 1 — cu^r 2 ) 


(5.11) 


where arctan 2(Im, Re) returns the phase angle of the complex number of Re + i Im. It 
returns c p ranged from — n to n while arctanflm/Re) returns c/> ranged from — n/2 to n/2. <^>(w m ) is 
the phase angle of GhighW at co m . <w m should be <w m < w u . It is recommended to choose &> m as a 
frequency close to the ultimate frequency <u u of the process. If oj m = <d u is chosen, then (5.10) 
and (5.11) become the following equations: 

— 7t = — 6co a + arctan2(— 2 £w u t, 1 — <u 2 r 2 ) (5-12) 

a = » + m:tan2(-2ft...l-^V) (5 . B J 

In summary, the reduced SOPTD model of (5.5) can be estimated from (5.6), (5.8), 
and (5.11). The same approach of (5.6), (5.8), and (5.11) can also be applied to the case that 
the frequency response data are available instead of the transfer function. 

Similarly, (5.14)—(5.16) can be derived to reduce the high-order model to the FOPTD model. 

k = Ghig h (0) (5.14) 


•y/^ 2 |Ghigh(i<Wm)| 
|Ghigh(i« m )|«m 


(5.15) 
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— <|>(cd m ) + arctan( — iw m ) 


(5.16) 


5.8.2 Modification to Consider Effects of Zeroes 

The above-mentioned model reduction method to obtain the reduced SOPTD model 
shows good performances if G h jg h G) has no zeroes or the magnitudes of the zeroes are 
large enough. It should be noted that the reduced SOPTD model (5.5) has no zeroes, so that it 
has a structural limitation in fitting the effects of the zeroes of G high (,s'). If G high (.s’) has 
some zeroes of which the magnitudes are small, then the least-squares method using (5.7)—(5.9) 
may provide the wrong parameters r and £. This is because the least-squares method tries to fit 
the effects of the zeroes of G h j gh (.s) by adjusting the poles (equivalently i and £) of the 
reduced SOPTD model. Sometimes, even though the high-order model is stable, the reduced 
model obtained could be unstable because the dominant zeroes of the high-order model can 
affect the pole positions of the reduced model. So, a modification is required to prevent 
the model reduction method from adjusting the poles of the reduced model to fit the zeroes 
of G high (s). 

The following modification using the equivalent time-delay concept is recommended. 
Consider the following zeroes part of GhighCfb 

(-zf 1)(-Z2 _lj + 1) • • • ( ~ z n lg + 1) = 1 - (zf 1 + z 2 _ 1 + • • • +z~ 1 )s+ ■■■ (5.17) 

The equivalent time delay can be represented by the Taylor series expansion: 

exp(— ^equivalents) = 1 ~ ^equivalents + • • • (5.18) 

From the comparison of (5.17) and (5.18) up to the second term, the following equivalent 
time delay is defined to approximate the zeroes of Ghi g h(s): 

^equivalent = Zf 1 + Z 2 “ 1 + • ■ ■ Z“ 1 (5.19) 

In summary, after removing the dominant stable and unstable zeroes of Ghi g h(s) and 
rearranging Ghi g h(s) to the modified high-order plus time-delay model of G h i g h,modifled(s), 
which has the equivalent time delay instead of the zeroes, the model reduction can be continued 
with G hjgh modified G). If a more conservative approach is preferred, then it is recommended to 
consider only unstable zeroes to estimate the equivalent time delay and just neglect the stable 
zeroes because the unstable zeroes lag the phase angle and the stable zeroes lead the phase 
angle. 

5.8.3 Model Reduction for Unstable Processes 

In the same way, the model reduction method can be applied to an unstable process. Assume 
that the requirement is to reduce the unstable high-order process to the following unstable 
SOPTD model: 
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Gm(s) = 


/texp( — 0s) 

(t s- 1)(t s j+ 1) 


(5.20) 


First, estimate the gain of the reduced model to fit the zero frequency response data 
follows: 


k = Ghigh(O) (5.21) 

And the model reduction method estimates t and t s to satisfy the equality (5.22) by 
solving (5.23) using the least-squares method. Equation (5.23) is derived from (5.22) in a 
straightforward manner. 




(5.22) 


(* 2 + G|Ci lg hK)| J <»? + ' 2 ^|Gh»l,(i«<;)lA 4 = k 1 - Ghi g h(iw,)| 2 

(5.23) 


O 

A 

e 

A 

A 

s 

(5.24) 

where it is recommended to choose u>„ as the ultimate frequency co u of the process. If 
o) u is not available, then w„ should be chosen as the closest one to <w u . The model 
reduction method finally estimates the time delay of the SOPTD model from the 
following phase-angle equation (5.25) with respect to ai m . Equation (5.26) is obtained directly 
from (5.25). 

/GhighO 

iw m ) = /G m (i<u m )=><()((w m ) = — n — 0(o m + arctan(rw m ) — arctan(T s w„ 

0 (5.25) 


— <t>(uAn) — It + arctan(Tw m ) — arctan(T s <w m ) 

0 = 

(5.26) 

where <l>((o m ) is the phase angle of G hig iXy) at co m . <o m should be a> m < co u . It is recommended to 
choose (o m as a frequency close to the ultimate frequency w u of the process. If co m = w u is 
chosen, then (5.25) and (5.26) become the following equations: 


— n= —n — 8(o u + arctan(rw u ) — arctan(T s w u ) 

(5.27) 


arctan(Tw u ) — arctan(T s w u ) 

6 = 

(5.28) 

In summary, the reduced unstable SOPTD model (5.20) can be estimated from (5.21), (5.23) 


and (5.26). 


Example 5.7 

Obtain the tuning parameters of a PID controller for the process of which the transfer function is 
Ghigh(s) = exp(— 0.1s)/(j + l) 3 using the IMC tuning rule. 
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Solution k= 1.0 is obtained from G high (0) = 1.0. Because Ghi gh (il.5) = —0.1705 — i0.0074, 
$(1.5) = arctan2(—0.0074, -0.1705) = -3.0984 and IG high (il.5)1 = 0.1707 at « m =1.5. 
From (5.15), t = 3.849 is obtained. Also, 6 = 1.133 is obtained from (5.16). So, the reduced 
FOPTD model obtained is G m (.s) = exp(— 1.133^)/(3.849^ + 1). Then, the IMC tuning rule 
provides k c = 3.118, t, = 4.415 and r d = 0.494 from Table 5.3. The MATLAB code is shown in 
Table 5.11. 


Table 5.11 MATLAB code to obtain the reduced FOPTD model in Example 5.7. 


mr_exl.m 

g_mr_exl.m 

clear; 

function [G]=g_mr_exl(w) 

w=l.5; 

s=i*w; 

g=g_mr_exl(w); 

G-exp (- 0.1 * s) / ( A 3; 

k=abs(g_mr_exl(0)); 
tau=sqrt(k A 2-abs(g) A 2)/abs(g)/w; 
theta= (-atan2 ( Ircac (g), real (g) ) +atan (- 
tau*w))/w; 

% k: static gain, tau: time contant, the¬ 
ta : time delay 

fp2%tf ('k=%5.3f tau=%5.3f theta=%5.3&-| 

end 

\ n t a) ; 

command widow 

k=l.000 tau=3.849 theta=l,133 
» imc_exl 

PI: kcs= 2.293, tis=4.415 

PID: kcs= 3.118, tis=4.:4TS, 
tds= 0.494 


i_-lau; th=theta; 

r=l. 7fefcli; pi_Jccs= (2*t+th) /2/r/k; pi^.l;is=t+th/2; 
r=0.25*th; pid_kcs=(2*t+th)/2/(r+th)/k; pid_tis=t+th/2; 
pid_tds=t*th/(2*t+th); 

fprintf('PI: kcs=%6.3f, tis=%6.3f \n' ,pi_kcs,pi_tis); 

£pjMEtSt f (' PID: kcs=%6.3 f > % 6 . jsfij, tds=%6.3f 

\n' , p i d_kcs, p : d_c:i.s, p i d_t.ds) ; 


Example 5.8 

Obtain the tuning parameters of the PID controller for the process of which the transfer function 
is G(,s) = exp(—0.1s)/(£ + l) 3 using the ITAE-2 tuning rule. 

Solution k = 1.0 is obtained from G h i g h(0)= 1.0. In (5.8), let us define p l = t 4 , <p Lk = 
|GM g h(i<Ujt)| 2 <w^, p 2 = 4t 2 £ 2 -2t 2 , <p 2 , k = |G h i g h(ict»*)and y k = k- |Ghigh| 2 - 
Then, p { and p 2 can be estimated by the least-squares method mentioned in Chapter 2. Then, 
x = p/ 4 and ^ m yf(p 2 + 2f 2 j /(4r 2 ) are obtained. And 6 is obtained from (5.13). The source 
code for the model reduction method is shown in Table 5.12. The estimated SOPTD model 
is G r _ m (s)= 1.000exp(—0.477s)/(1.510V + 2 x 1.510 x 0.86D + 1). Then, A: c = 2.784, 
Xi = 2.702 and r d = 0.924 for the step setpoint change and k c = 6.866, Xi = 1.382 and r d = 0.685 
for the step input disturbance rejection are obtained from Table 5.7. 
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Table 5.12 MATLAB code to obtain the reduced SOPTD model in Example 5.8. 


w=0.0; delta_w=0.05; 

while (1) % search boundary in which wu 
exists 

w=w+delta_w; g=g_mr_ex2(w); 
if(imag(g)>0.0) break; end 
end 

wl=w-delta_w; w2=w; % w 1< wu < w2 
while (1) % Qnt$ wu using the bisectibh 
method 

w=(wl+w2)/2; gl=g_mr_ex2(wl) ; 
g=g_mr_ex2(w) ; 

1|f(imag(g)*im&g(gl)>0.0) wl=w; else 
w2=w; end 

if(abs(imag(g))<0.000001) break; end 
end 

wu=w; % ultimate frequency wu is found 
k=abs(g_mr_ex2(0) ) ; 
fot-^el: 10 % least square method 
w=(j-1)*wu/9.0; G(j)=g_mr_ex2(w); 
y(j f1)=k A 2-(abs(G(j)) A 2) ; 
phi_l (;,'.) = (abs (G (j ) ) A 2) *w A 4; 

P hi_2 (j/1) = (abs (G (j ) ) A 2) *w A 2; 
end % P_hat: solutionthe least square 
method 

PHI=[phi_l phi_2 ] ; Y=y; 

P_hat=inv(PHI'*PHI)*PHI'*Y; 

tau=P_hat(1) A (1.0/4.0); 

xi=((P_hat(2)+2*tau A 2)/(4*tau A 2)) 


[G]=g_mr_ex2(w) 

G=exp (-0.l*s)/ (s + 1) A 3; 


command window 

» mr_ex2 
k=l.000 tau=l.510 
xi=0.8 61 Lr.eta-0.47'7 
» itae_ex2 

kcs= 2.784, -..is- 2.702, tds= 
0.924 

kcd= 6.866, tid= 1.382, tdd= 
0.685 


theta= (pifa Lan2 (-2*xi*tati*Wu, l-wu A 2*- 
tau A 2))/wu; 

% tau : time contant, xi : damping factor, 
theta; time delay 

fprintf (' k=i|.i3f tau*f§ . 3f \n' , k, tau) ; 
fpfiktf ( f xi=%5.3f theta-%5.3f \n' ,xi, 
theta); 


itae. 


_ex2. m 


k=k; t=tau; d=xi; th=theta; 

% static gain, time constant, dampling factor, time delay 
if(d<^0.9) 

kcs=(-0.0l#|0.333+0.949*(th/t) A (-0.983))*d)/k; 
else 
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Table 5.12 ( Continued ) 


kcs=(-0.544+0.308*th/t+1.408*(th/t) A (-0.832)*d)/k; 

if ( (th/1)<=1.0) 

tis= (2.055 + 0.07l#§^A) *d*t; 

tis=(l.768+0.329*th/t)*d*t; 

tds=t/ (1.0-exp (- ( Jr./ L) A ('. . C 60) *d/C . 87 0) ) / (0.55 + 1.683* (th/t) A 
(-1.090)); 
if((th/t)<0.9) 

kcd=(-0.670+0.297*(th/t) A (-2.001)+2.189*(th/t) A (-0.766)*d)/k; 

kcd=(-0.365+0.260*(th/t-1.400) A 2+2»189*(th/t) A (-0.766)*d)/k; 
end 

if((th/t)<0.4) 

tid=(2.212*(th/t) A (0.520)-0.300)*t; 

tid=(-0.9ilf50.9i|s(th/t-1.845) A 2+(1-exp(-d/(0.150+0.330*th/t)))* 
(5.250-0.880*(th/t-2.800) A 2))*t; 
end 

tdd=t/(-1.900+1.576*(th/t) A (-0.530)+(1-exp(-d/(-0.1-1+0.939*(th/t) A 
.121) ) ):) * (1.45+0.969* (th/t) A (-1.171))); 

fprintf('kcs=%6.3f, tis=%6.3f, tds=%6.3f \n', kcs, tis,tds); 
fprintf (' kcd=%6.3f, tid=%6.3f, tdd=%6 .3f \n', kcd, tid, tdd) ; 


Example 5.9 

Obtain the tuning parameters of a PID controller using the ITAE-2 tuning rule for 
the process of which the frequency responses are as follows: Ghi g h(i0.0)= 1.00 —i0.00, 
G high (i0.2) = 0.50 - i0.76, G high (i0.4) = -0.22 - i0.65, G high (i0.6) = -0.42 - i0.20, 
Gh igh (i0.8) = — 0.28 — i0.07, G^(il.O) = -0.13 + i0.13. 

Solution k= 1.0 is obtained from Ghi gh (0)= 1.0. In (5.8), let us define p l = t 4 , (p xk = 
\G m (u> k )\ 2 a> A k ,p 2 = 4t 2 £ 2 -2t 2 , <p 2 , k = \G m (ia> k )\ 2 (^ k and y k = 1 - |Gh igh (io>*) | 2 . Then, 
p 1 and p 2 can be estimated by the least-squares method mentioned in Chapter 2. Then, z = p[' 4 
and£ = \j(p 2 + 2t 2 ) / (4t 2 ) are obtained. And 6 is obtained from (5.11). It should be noted that 
the sixth frequency data of Ghi g h(il-0) = —0.13 + i0.13 should not be used to estimate the time 
delay in (5.11) because it is out of the range of arctan2(Im, Re). So, the fifth frequency 
response data of Ghi g h(i0.8) = —0.28 — i0.07 is used in (5.11) in this case. The source code 
for the least-squares method is shown in Table 5.13. The estimated SOPTD model is 
G r _ m (.s) = 1.000 exp(-0.852j)/(2.205V + 2 x 2.205 x 0.797j + 1). Then, k c = 2.151. 
ti= 3.658 and r d = 1.465 for the step setpoint change and k c = 4.932, Ti = 2.313 and 
r d = 1.173 for the step input disturbance rejection change are obtained from Table 5.13. 
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Example 5.10 

Obtain the tuning parameters of a PID controller using the ITAE-2 tuning rule for the following 
process: 


Ghigh(-S') 


(— 0.3s + l)exp( — 0.3s) 

(s+1) 3 


(5.29) 


Solution The unstable zero part of (—0.3s + 1) is approximated by the equivalent time delay 
of exp(—0.3s). Then, process (5.29) can be approximated by the following modified model: 


exp( — 0.6s) 

^tii# 


(5.30) 


Now, (5.30) can be reduced to the SOPTD model G m (s) = 1.000 exp(— 1.004s)/( 1,440 2 s 2 4- 
2 x 1.440 x 0.908s + 1) by using the model reduction method in Table 5.14. Then, the tuning 
parameters k c = 1.396, T\ = 2.752 and r d = 0.929 are obtained by the ITAE-2-setpoint tuning 
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Table 5.13 ( Continued ) 


k-k; d-xi; th=theta; 

% static gain, time constant, damplin.grfactor, time delay 
if(d<=0.9) 

kcs=(-0.04+(0.333+0.949*(th/t) A (-0.983))*d)/k; 

kcs=(-0.544+0,308*th/t+1.408*(th/t) A (-0.832)*d)/k; 
end 

if ( (th/1)<=1.0) 
tis=(2.055+0.072*th/t)*d*t; 

tis=(l.768+0.329*th/t)*d*t; 
end 

tds=t/ (1.0-exp (- (th/t) A (1.0 6#}: *d/0.87 0) ) / (0.55 + 1.683* (th/t.) A 
(-1.090)); 
if ( (th/t)<0.9) 

kcd=(-0.670+0.297*(th/t) A (-2.001)+2.189*(th/t) A (-0.766)*d)/k; 
else 

kcd=(-0.365 + 0.260*(th/t-1.400) ; 4S+2.18 9*(th/t) A (-0.7 66)*d)/k; 
end 

if((th/t)<0.4) 

tid=(2,212*(th/t) A (0.520)-0.300)*t; 
else 

tid= (-0.975 + 0.910* (th/t-1.84o) A 2l (1-exp (-d/ (0.150 + 0.330*th;/fe)J }<* 
(5.2 5 0 - 0.8 8 0 * (t h /1-2. 8 0 0) A 2) } * t; 

tdd=t/ (-1.900+||'*,i76* (th/t) A (-0.530) + (1-exp (-d/ (-0.1&+0.939* (th/t) A 
(-1.121))))*(1.45+0.969*(th/t) A (-1.171))); 

fpti&t&Tfc' kcs=%6.3£, tis=%6.3f, tds=%6.3f \jJrT,'kcs, tis, tds) ; 
fpnifttf V kcd=%6.3f, tid=%6.3f, tdd=%6.3f W , kcd, tid, tdd) ; 


rule. Figure 5.16 shows the control performance. The ITAE-2 tuning rule on the basis of the 
approximation model (5.30) shows excellent tuning results. It confirms that the approximation 
using the equivalent time delay is acceptable. 


Example 5.11 

Obtain the tuning parameters of a PID controller using the ITAE-2-setpoint tuning rule for the 
following process: 


(0.7.S+1)(-0.3+l)exp(-0.4s) 

a w W =-- 


(5.31) 


Solution In this case, the stable zero part of (0.1s + 1) should be eliminated for a 
conservative model reduction. And the unstable zero part of (—0.3 + 1) is approximated by 
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Table 5.14 MATLAB code to solve the design problem and simulate the PID controller 
in Example 5.10. 


mr ex4.m 

command window 

clear; 

» mr_ex4 

w=0.0; delta_w=0.05; 

k=1.000 tau=l.440 

while (1) % search boundary in which wu 

xi=0.908 theta—'. .004 

exists 

»iLae_ex4 

w=w+delta_w; g=g_mr_ex4(w); 

Jccs- 1.396, tis= 2.752, tds= 

If(imag(g)>0.0) break; end 

0.92 9 

end 

kcd= 2.560, tid= 2.099, tdd= 

wl=w-delta_w; w2=w; % w 1< wu < w2 

0.95; 

while (1) % find wu using the bisection 

» pid_itae2_ex4 

method 


w=(wl+w2)/2; gl=g_mr_ex4(wl) ; 

g_mr_ex4 . m 

g=g_mr_ex4(w); 

function JG] =g_mr_ex4 (w) 

if(imag(g)*imag(gl)>0.0) wl=w; else 

s=i*w; 

w2=w; end 

G=exp(-0.6*s)/(s+1) A 3; 

if(abs(imag(g))<0.000001) break; 

end 

end 


end 

g_pid_itae2_ex4.m 

wu=w; % ultimate frequency wu is found 


k=abs(g_mr_ex4(0)); 

function tnext_x y]=g_pid_ 

for j=l: 10 % least square method 

■:|.tae2_ex4 (x, del.tyu) 

w=(j-l)*wu/9.0; G(j)=g_mr_ex4(w); 

subdelt=delt/5; 

y(j , 1)=k A 2-(abs(G(j)) A 2); 

;ii=round (delt/subdelt) ; 

phi_l , 1) = (abs (G (j ) ) A 2) *w A 4 ; 

A=[0 0 -1 ; 1 0 -3 0.1-3] ; B=[l 

phi_2(j,1)=(abs(G(j)) A 2)*w A 2; 

; -0.3; 0 ]; 

end % P_hat: solution of the least 

#hP 0 1]; delay=0.3 ; 

square method 

delay_k=round(delay/delt); 

PHI= [phi_l phi_2] ; Y=y; P_hat=inv 

| :n 

(PHI'*PHI)*PHI'*Y; 

dx=A*x+B*u(500-delay_k) ; 

tau=P_hat(1) A (1.0/4.0); 

x=x+dx*subdelt; 

xi = ((P_hat(2)+2*tau A 2)/(4*tau A 2)) 

end 

A 0.5; 

next_x=x; y=C*x; 

theta=(pi+atan2(-2*xi*tau*wu, 1- 

end 

wu A 2*tau A 2))/wu; 


% tau: ti^ift contant, xi: damping fiad+-' 


tor, theta: time delay 


fprintf (' k=%5.3f tau=%5.3f \n' , k. 


tau) ; 


fprintf (' xi=%5.3f theta=%5. 3^ 


\n',xi, theta) i 



itae_ex4.m 


k=k; t=tau; d=xi; th=theta; 

% static gain, time constant, dampling factor, time delay 
if(d<=0.9) 

:<cs-(-0.0.< t (0.333+0.949* (th/t) A (-0.983) ) *d) /k; 
else 
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Table 5.14 ( Continued) 


kcs=(-0.544+0.308*th/t+1.408*(th/t) A (-0.832)*d)/k; 

if ( (th/1)<=1.0) 

tis= (2.055 + 0. 07l*igf|A) *d*t; 

tis=(l.768+0.329*th/t)*d*t; 

tds=t/ (1.0-exp (- ( Jr./ L) A ('. . C 60) *d/C . 87 0) ) / (0.55 + 1.683* (th/t) A 
(-1.090)); 
if((th/t)<0.9) 

kcd=(-0.670+0.297*(th/t) A (-2.001)+2.189*(th/t) A (-0.766)*d)/k; 

kcd=(-0.365+0.260*(th/t-1.400) A 2+2»189*(th/t) A (-0.766)*d)/k; 
end 

if((th/t)<0.4) 

tid=(2.212*(th/t) A (0.520)-0.300)*t; 

tid=(-0.9itf0.9ii*(th/t-1.845) A 2+(1-exp(-d/(0.150+0.330*th/t)))* 
(5.250-0.880*(th/t-2.800) A 2))*t; 
end 

tdd=t/(-1.900+1.576*(th/t) A (-0.530)+(1-exp(-d/(-0.15+C.939*(th/t) A 
|™L.121)|J.) * (1.45+0.969*(th/t) A (—1.171))); 
fprintf('kcs=%6.3f, tis=%6.3f, tds=%6.3f \n', kcs, tis,tds); 
fprintf('kcd=%6.3f, tid=%6.3f, tdd=%6.3f \n', kcd, tid, tdd) ; 


pid_itae2_ex4.m 

kc=kcs; td=tds; 

t=0.0; t_)fiag.l**l5.0; 

x=[0 00]'; y=0.0; yb=0.0; ys=0.0; ysb=0.0; dis=0.0; 
delta_t=0.02; n=round(t_final/delta_t); 
h_u=zeros(1,500); s=0.0; 
fo£\i*l:n 

t_array(i)=t; y_array(i)=y; ys_array(i)=ys; 

if(t>l) ys=1.0; elseys=0.0; end % setpoint change simulation 
% if(t>l) dis=1.0; elsedis=0.0; end % disturbance rection simulation 
s=s+(kc/ti)*(ys-y)*delta_t; 

J '|i=kc* (ys-y) +s+kc*td* ( (ys-y) - (ysb-yb) ) /deiita(_t; 
ysb=ys; yb=y; % one sampling before 
#_array(i)=u; 
for j=l:499 
h_u (j ) =h_u (H+’i-) ; 

h_u(5 0 0)=u+dis; 

[x y]=g_pid_itae2_ex4(x,de1La_L,h_u); 
t=t+delta^.|' 

figure(3); plot(t_array,ys_array,t_array,y_array) ; legend('y_{s} 

(t) ' , ' y (t) ' ) ; 

figure (2) ; plot (t_array, u_array) ; 
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Figure 5.16 Ti 
the equivalent 


(b) 

lining results of the ITAE-2 tuning rule with the approximated model in Example 5.10. 
time delay of exp(—0.3s). Then, the modified model is 


exp(-0.7s) 

(.v+1) 3 


(5.32) 


Finally, the reduced SOPTD model (5.33) is obtained by applying the model reduction 
method to G Wgh , modifi ed(j)- 


exp( - 1.107,y) 

1.431V+ 2 x 1.431 x 0.913.V+ 1 


(5.33) 


Finally, the tuning parameters k c = 1.286, %\ = 2.758 and r d = 0.937 are obtained from 
Table 5.7. 

Table 5.15 and Figure 5.17 show the control performance of a PID controller designed by the 
ITAE-2 tuning rule based on the approximate model. Because the stable zero is neglected, a 
conservative control action is obtained. 
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Table 5.15 MATLAB code to solve the design problem and simulate the PID controller 
in Example 5.11. 


_exb .m command window 



(' k=%5.3f bau=%5.3f \n', k, tau) ; 
fptsttffcf {'x±=%5.3f theta^fl. 3f 
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Table 5.15 ( Continued ) 


itae_ex5.m 

k=k; t=tau; d=xi; th=theta; 

% static gai-tx.f time constant, dampli«t|f delay 

if(d<=0.9) 

kcs=(-0.04+(0.333+0.949*(th/t) A (-0,983))*d)/k; 

kcs=(-0.544+0,308*th/t+1.408*(th/t) A (-0.832)*d)/k; 
end 

if ( (th/1)<=1.0) 

tis= (2.055 + 0 . C72*t|i/t) *d*t; 

tis=(l.768+0.329*th/t)*d*t; 

tds=t/(1.0-exp(-(th/t) A (1.06tifd/0.870))/(0.55+1.683*(th/t) A 
(-1.090)); 
if((th/t)<0.9) 

kcd=(-0.670+0.297*(th/t) A (-2.001)+2.189*(th/t) A (-0.766)*d)/k; 

kcd=(-0.365+0.260*(th/t-1.400) A 2+2.189*(th/t) A (-0.766)*d)/k; 
end 

if((th/t)<0.4) 

tid=(2.212*(th/t) A (0.520)-0.300)*t; 

tid=(-0.91^0.9rp* (th/t-1.845) A 2+ (1-exp (-d/ (0.150 + 0.330*th/t) ) ) * 
(5.250-0.880*(th/t-2.800) A 2))*t; 
end 

tdd=t/(-1.900+1.576*(th/t) A (-0.530)+(1-exp(-d/(-0.15+0.939*(th/t) A 
(-1.121))))*(1.45+0.969*(th/t) A (-1.171))); 
fprintf('kcs=%6.3f, tis=%6.3f, tds=%6.3f \n', kcs, tis,tds); 
fprintf('kcd=%6.3f, tid=%6.3f, tdd=%6.3f \n' , kcd, tid,tdd); 


pid_i tae2_ex5lvp* 

%kc=kcs; ti=tis; td=tds; 
kc=kcd; ti=tid; td=tdd; 
t=0.0; t_final=20.0; 

x=[0 0 0]'; y~0^.0; yb=0.0; ys=0.0; ysb=0.0; dis=0.0; 
delta_t=0.02; n=round (t_final/delta_t) ; 
h_u=zeros (1,500) ; s=0.0; 
f or i- '. : r. 

t_array(i)=t; y_array(i) =y; ys_array(i)=ys; 

% if (t>l) ys-i.0; else ys=0.0; end % setpoint change simulation 

if(t>l) dis = 1.0; elsedis=0,0; end % disturbance rection simulation 
s=s+(kc/ti)*(ys-y)*delta_t; 

•^=kc*(ys-y)+s+kc*td*((ys-y)-(ysb-yb))/detfe9Lt; 
ysb=ys; yb=y; % one sampling before 
u_array(i)~u; 
for j=l: 499 
h_u(j)=h_u{|+'l)^ 
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Figure 5.18 Cascade control system. 


The ultimate gain of the open-loop transfer function exp(—0.1 s)/(s + 1 ) 2 is /c u = 20.67. Let 
us choose ki = 6.89(k, = kJ3) as the proportional gain of the internal feedback loop. Then, the 
transfer function from u(t) to y(t) is 


G (V) = ZM = - jiffy + 1 ) 5 

overallU u(s) l + 6.|fp^-0.Ly)/(.v+l) 2 


(5.34) 


Note that the PID controller should be tuned for the overall process. Then, (5.34) should be 
reduced to the SOPTD model to tune the PID controller using the ITAE-2-setpoint. The reduced 
SOPTD model obtained by the model reduction method is G m (s) = 0.873 exp(—1.1365)/ 
(1.261 2 ^ 2 + 2 x 1.261 x 0.964s + 1) and the tuning parameters by the ITAE-2-setpoint based 
on the reduced model are k c = 1.390, = 2.577 and i d = 0.823. 

The MATLAB code for Example 5.12 and the simulation results are shown in Table 5.16 and 
Figure 5.19 respectively. 


Example 5.13 

Consider the PID control combined with the internal feedback loop of the P controller in 
Figure 5.20. Design the PID controller and the internal P controller of G ci (s) = k\ for G(s) = exp 
(—0.2s)/[(5s — l)(s + I) 2 ], 

Solution First, the unstable process G(s) = exp(—0.2s)/[(5s — 1 )(s + l) 2 ] is reduced to the 
SOPTD model G m (s) = exp(-0.713.s)/(4.860.s- 1)/(1.616^ + 1) by the model reduction 
method for the unstable process. Then, the P controller tuned by the optimal gain margin 


Table 5.16 MATLAB code to solve the design problem and simulate the PID controller 
in Example 5.12. 


clear; 

w=0.0; delta_w=0.05; 

wh i '. e (>) % search boundary in which 

w=w+delta_w; g=g_mr_ex6(w); 

( irrac (q) >0.0) break; end 

end 

wl=w-delta_w; w2=w; % w 1< wu < w2 
while|J;| % find wu using the bisection 
method 


command window 
»tnr_ex6 
k=0.873 uau-: .2 6". 
xi=0.964 theta=l.136 
»itae_ex6 

kcs= 1.390, : s - 2.577, tds= 0.823 

kcd= 2.273, tid= 2.108, tdd= 0.880 
» pid_itae2_ex6 


function [G]=g_mr_ex6(w) 
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Table 5.16 ( Continued ) 


itae_ex6.m 

k=k; t=tau; d=xi; th=theta; 

% static qhip., trifle constant, damplisijt factor#, ©taje-delay 
if(d<=0.9) 

kcs=(-0.04+(0.333+0.949*(th/t) A (-0,983))*d)/k; 

kcs=(-0.544+0,308*th/t+1.408*(th/t) A (-0.832)*d)/k; 
end 

if ( (th/1)<=1.0) 

tis= (2.055 + 0 . C72*t|i/t) *d*t; 

tis=(l.768+0.329*th/t)*d*t; 

tds=t/(1.0-exp(-(th/t) A (1.0 6tifd/0.87 0))/(0.55 + 1.683* (th/t) A 
(-1.090)); 
if((th/t)<0.9) 

kcd=(-0.670+0.297*(th/t) A (-2.001)+2.189*(th/t) A (-0.766)*d)/k; 

kcd=(-0.365+0.260*(th/t-1.400) A 2+2.189*(th/t) A (-0.766)*d)/k; 
end 

if((th/t)<0.4) 

tid=(2.212*(th/t) A (0.520)-0.300)*t; 

tid=(-0.91^0. OW* (th/t-1.845) A 2+ (1-exp (-d/ (0.150 + 0.330*th/t) ) ) * 
(5.250-0.880*(th/t-2.800) A 2))*t; 
end 

tdd=t/(-1.900+1.576*(th/t) A (-0.530)+(1-exp(-d/(-0.15+0.939*(th/t) A 
(-1.121))))*(1.45+0,969*(th/t) A (-1.171))); 
fprintf('kcs=%6.3f, tis=%6.3f, tds=%6.3f \n', kcs, tis,tds); 
fprintf ('kcd=%6.3f, tid=%6.3f, tdd=%6.3f \n' , kcd, tid, tdd) ; 


pid_itae2_ex6.m 

kcl=kcs; til=tis; tdl=tds; %primary PID 
kc2=6.89; %secondaryP 

ysl=1.0; dis=0.0; %setpoint and disturbance 

tf=20; delt=Q.02; tf_k=round(tf/delt); 

uul=zeros (1,500); uu2-zeros(1,500); yy2=zeros(1,500); 

xl=zeros(3,1); x2=zeros(2,1); 

yl=0.0; ylb=0.0; sl=0.0; ys'.b-C.O; y2-0.0; y2b=0.0; 
for k=l: tf_k 
t=(k-1)*delt; 

T(k)=t; Yl(k)=yl; Y2(k)=y2; Ysl(k)=ysl; 

U1(k)=uul(500); U2(k)=uu2(500); 
for : 499 uul (i) -uul (i+1) ; end 
’for i=l: 499 uu2-(i)=uu2‘‘(§|@-l) ; end 
for i=l: 499 yy2 (i) =yy2 (i+1) ; end 
sl = sl+(kcl/til)*(ysl-yl)*delt; 

.Uiil (500) =kcl* (ysl-yl) +sl+kcl*tdl* (ysl-yl-yslb+ylb) /delt; 
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Table 5.16 ( Continued ) 


"nyj'Z (500) =kc2 * (uul (500) -y2) ; 
yy2(500)=y2; 
ylb=yl; yslb=ysl; 

[x2, y2 ] =g_pid_itae2_ex6_s (x2, delt, uu2> %cascade 
y2=y2+dis; %disturbance 

[xl,yl]=g_pid_itae2_ex6_p(xl,delt, yy2) ; 
end 

figure (1) ; plot (T, Ysl, T, Yl) ; 
figure (2) ; plot(T,Ul) ; 


tuning rule in Table 5.9 is k\ = 2.177. Now, the overall transfer function from ii(t) to y(t) of 
Goveraii(-s') = G(s)/( 1 + G(s)k t ) can be reduced to (5.35) using the model reduction method for 
the stable process. Then, the PID controller can be designed by the ITAE-2-setpoint on the basis 
of the reduced model as shown in (5.35): 


Gm{s) 


0.850exp(- 0.792s) 
2.633 2 s 2 + 2 x 2.633 x 0.305s + 1 


G c (s)= 1.182 I 


—+ 4.157s I (5.35) 


Tha MATLAB code and the simulation result are shown in Table 5.17 and Figure 5.21 
respectively. 



Figure 5.19 Tuning results of the ITAE-2 rule on the basis of the reduced model in Example 5.12. 


»Qh | PID(s) | U{S) + »0 - G(s) 


Figure 5.20 PID control combined with an internal feedback loop to control an unstable process. 
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Table 5.17 ( Continued) 


subdelt=delt/5; n=round(delt/sub- 

s=i*w; 

delt); 

G=exp(-0.2*s)*(l+tdi*s) Mfifs-1 )/ 

A= [0 0 1/5 ; t:0 -3/5.; 0 1 -9/5]; 

(s+1) A 2; 

B-ll/b; 0 ; 0]; C=[0 0 1]; 

end 

delay=0.2; 


do : ay_k-.ro.land (delay/delt) ; 


for i=l: n 


dx=A*x+B*u(500-delay_k); 


x=x+dx*subdelt; 


end 


next_x=x; y=C*x; 


end 



0GM_unstable_ex7.m 
k=k; t=tau; ts=taus; th=theta; 

% static gain, time constant (unstable) , time constant (stable) , time delay 
w=0.0; delta_w=0.05; 

while (1) % search boundary in which wu exists 
w=w+delta^w; g=g_0GM_unstable_ex7(w,0); 
if(imag(g)>0.0) break; end 

wl=w-delta_w; w2=w; % w 1< wu < w2 
while (1) % find wu using the bisection method 
w=(wl+w2)/2; gl=g_0GM_unstable_ex7(wl,0); 
g=g_0GM_unstable_ex7(w,0); 

if(imag(g)*imag(gl)>0.0) wl=w; else w2=w; end 
if(abs(imag(g))<0.00000001) break; end 
end 

wu=w; % ultimate frequency wu is found 
gu=g_0GM_unstable_ex7(wu,0); 

P_ki=l/sqrt (abs (gu) *abs (k) ) ; % tuning parameter for P controller 


Xl=-Q.003+0.64 82*(ts/t)-2.2841*(ts/t) A 2+2.6221*(ts/t) A 3-0.9611*(ts/ 
t) A 4 ; 

X2=0.244 6-1.0410* (ts/t)+13.6723* (ts/t) A 2-16.7 622* (ts/t) A 3-o.'. 4 71 * 
(ts/t) A 4; 

X3=0.1685+0.8289*(ts/t)-9.3630*(ts/t) A 2+2.9855*(ts/t) A 3+7.3803*(ts/ 
t) A 4 ; 

PD_tdi=t*(X1+X2*(th/t)+X3*(th/t) A 2); % td for PD controller 
w=0.0; delta_w=0.05; 

while (1) % search boundary ih which wu exists 
w=w+delta_w; g=g_OGM_unstable_ex7(w,PD_tdi); 
if(imag(g)>0.0) break; end 

wl=w-delta_w; w2=w; % w 1< wu < w2 

while (1) % find wu using the bisection method 

w=(wl+w2)/2; gl=g_OGM_unstable_ex7(wl,PD_tdi); g=g_OGM_unstable_ex7 
(w,PD_tdi); 


(continued) 
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Table 5.17 ( Continued ) 


tis=(l.768+0.329*th/t)*d*t; 

lds-L/(1.0-exp(-(th/t) A (1.060)*d/C.870))/(0.55+1.683*(th/t) A 
(-1.090)); 
if ( (th/t)<0.9) 

kcd=(-0.670+0.297*(th/t) A (-2.001)+2.189*(th/t) A (-0.766)*d)/k; 

kcd=(-0.365+0.260*(th/t-1.400) A 2+2.189*(th/t) A (-0.766)*d)/k; 
end 

if((th/t)<0.4) 

tid=(2.212*(th/t) A (0.520)-0.3CC)*t; 

tid=(-0.973*0.910*(th/t-1.845) A 2+(1-exp(-d/(0.150+0.330*th/t)))* 
(5.250-0.880*(th/t-2.800) A 2)|ff|; 
end 

tdd=t/(-1.900+1.576*(th/t) A (-0.530)+(1-exp(-d/(-0.15+0.939*(th/t) A 

(-1.121))))*(1.4 5+0i 969*(th/t) A (-1.171))); 

fprintf('kcs=%6.3f, tis=%6.3f, tds=%6.3f\n',kcs,tis,tds); 

fprintf('kcd=%6.3f, tid=%6.3f, tdd=%6.3f\n',kcd,tid,tdd); 


p i d_OGK_ur.s Lab I e_ex 7 . m 

%kci=PD_ki; tdi=PD_tdi; % OGM_unstable tuning parameters 

kci=P_ki; tdi=0.0; % OGM_unstable tuning parameters 

kc=kcs; ti=tis; td=tds; % ITAE-2-setpoint tuning parameters 

t=0.0; tjinal—50.0; x=[Q.Q0]'; y=0.0; yb=0.0; ys=0.0; ysb=0.0; dis=0.0; 

delta_t=0.02; n=round (tjirtal/deifcd^t) ; s=0.0; lj-.W~zeros (1,500) ; 

for i=l:n 

t_array(i)=t; y_array(i)=y; ys_array(i)=ys; 

if(t>l) ys-1.0; elseys=0.0; end % setpoint change simulation 
% rgp|(t>l) dis=1.0; else dis=0.0; end % disturbance rectidp simulation 
s=s+(kc/ti)*(ys-y)*delta_t; 

,t|i=kc* (ys-y) +s+kc*td* ( (ys-y) - (ysb-yb) ) /deit.a_t; 
itji=kci*y+kci*tdi* (y-yb) /delta_t; 
ysb=ys; yb=y; % one sampling before 
u_array (ifste-ui; 
for j=l:499 

h_n (j, > =>h_u , 

end 

h_u(500)=u-ui+dis; 

[x y]=g_pid_OGM_unstable_ex7(x,delta_t,h_u); 
t=t+delta_t; 
end 

figure(3); plot(t_array,ys_array,t^afciay,y_array) ; 
legend('y_{s}(t)','y(t)'); 
figure (2) ; plot (t_array, u_array) ; 
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Figure 5.21 Control performance of a PID controller combined with an internal P controller tuned by 
the ITAE-2-setpoint and the OGM-unstable tuning methods based on the reduced models. 


5.9 Consideration of Modeling Errors 

If the process model has significant errors, then the PID controller should be tuned in a 
conservative way. The simplest method to incorporate the modeling error is to modify the 
model parameters in the direction that the tuning rules provide more conservative tuning 
parameters. From the tuning formula for the IMC, ITAE-1 and ITAE-2, it is clear that the tuning 
parameters become conservative as increasing k, x and 6/x of the FOPTD and SOPTD models. 
So, the recommendation is to use new adjustable parameters (e k , e x and eg/ x ) in the form 
k = k( 1 + e k ), r = t( 1 + e T ) and 9 = 0( 1 + e T ) (1 + e#/ T ). For example, if 5% modeling errors 
are assumed (that is, e k =e r = e oh = 0.05), then k 1 ,05k, x = 1 .05t and 0= 1.O5 2 0 will be 
obtained. Then, the tuning rules on the basis of the modified model of k = 1.05/c, x = 1 .05t and 
6 = 1 ,05 2 0 would provide more conservative tuning parameters. For the ZN tuning rule, 
adjustable parameters ( e k and e p ) in the form of k u = k u /( 1 + e k ) and p u = p u ( 1 + e p ) can be 
used to consider the modeling errors. 

5.10 Concluding Remarks 

Several simple PID tuning rules are introduced in this chapter. If the dynamics of the process are 
simple and a roughly tuned PID controller satisfies the control requirements, then trial-and-error 
tuning is sufficient. For a more systematic tuning, the ZN, IMC, ITAE-1 and ITAE-2 tuning rules 
are available for a stable process. The ZN tuning rule needs the ultimate frequency data of the 
process and the IMC and ITAE-1 tuning rules require the FOPTD model. The ITAE-2 needs 
the SOPTD model. Among the ZN, IMC and ITAE-1 tuning rules, the IMC tuning rule and the 
ITAE-1-disturbance show the best tuning result for the step setpoint change problem and for the 
step input disturbance rejection problem respectively. ITAE-2 shows almost the same responses 
as those of the optimal tuning. If the aim is for high performance or the process is underdamped, 
then the ITAE-2 tuning rule is recommended. Also, the optimal gain margin tuning rule for an 
unstable process is introduced. If the given process is high order, then it can be reduced to an 
FOPTD or SOPTD model using the model reduction method. Then, it is straightforward to tune 
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the PID controller using the above-mentioned tuning rules. The tuning strategy using model 
reduction is useful for the tuning of a PID controller combined with an internal feedback loop for 
cascade control, an integrating process and an unstable process. 


Problems 

5.1 Find the tuning parameters of a PID controller using the IMC and the ITAE-1 tuning rules 
for the process G(s ) = 1.5 exp(—().3,y)/(10,y + 1). 


(a) no modeling errors. 

(b) 3% modeling errors. 


5.2 Reduce the process G(s) = 2.0exp(—0.2s)/(s + l) 3 to an FOPTD model and tune the PID 
controller for the process using the IMC and the ITAE-1 tuning rules. 

5.3 Find the tuning parameters of a PID controller using the ITAE-2 tuning rule for the process 
G(s) = 5.0exp( — 0.3s)/(2.y 2 + 6.0.S+ 1.5). 

5.4 Find the tuning parameters of a PID controller using the ITAE-2 tuning rule for the process 
G(s) = 5.0( — 0.25+ l)exp( — 0.3s)/(2.y 2 + 6.0s + 1.5). 

5.5 Find the tuning parameters of a PID controller using the ZN tuning rule for the following 
processes: 


(a) 

(b) 

(c) 

(d) 

(e) 

(f) 


2.0^-+ y (t) = 1.5w(f —0.3) 
2.0^-+ y (t) = 1.5w(?-0.3) + 5.0 


G(s) = 


3.0exp( — 0.5,s) 
2.y 2 + 5.y + 1 


g d y(t) 




+ 1.2 y(t) = 1.0m(;-0.1)+0.5 


G{s) = 
G(s) = 


(^+i r 

- 2.0 

(^+ 1 ) 3 ' 


5.6 Find the tuning parameters of a P and a PD controller for the process G(s ) = 2.0 exp 
(—0.1^)/(3^— l)(w + 1). 

5.7 Reduce the process G(s ) = 2.0 exp(—0.2,y)/(.y + l) 3 to an SOPTD model and tune the PID 
controller for the process using the ITAE-2 tuning rules. Simulate the control performance 
of the PID controller for a step setpoint change and a step input disturbance. 

5.8 Find the tuning parameters of a PID controller using the ZN, IMC, ITAE-1 and ITAE-2 
tuning rules and compare the control performances for the process G(s ) =1.5 exp(—0.3.y)/ 
(,s + l)(2s + l)(3s + 1). 

5.9 Find the tuning parameters of a PID controller using the ITAE-2 tuning rule and simulate 
the control performance for the step setpoint change at t= 1.0. You should define new 
deviation variables for the appropriate implementation of the PID controller. y 0 (t) is not 
measurable. The process output and the process input are y(t) and u(t ) respectively. 



198 


Process Identification and PID Control 


dyo(Q | 

dt u 


= 0 , 


^ + 2 ^M +w( ,) = „(,_0.3) + 1.0 


equivalently 


y{t) =yo(0 + 3 -° 

dy(t) 


0, y(0) = 3.0, u(t) = — 1.0 for t<0 


5.10 Run the virtual process of Process 1 (refer to the Appendix for details) and tune the PID 
controller using the trial-and-error tuning rule. 

5.11 Run the virtual process of Process 1 and tune the PID controller using the continuous- 
cycling method. 

5.12 Run the virtual process of Process 1 and tune the PID controller using the IMC tuning rule. 
Use the PRCmethod to estimate the FOPTD model. 

5.13 Find the tuning parameters of a PID controller for the process of which the frequency 
responses are 


(a) G(i0.0) = 1.5 - i0.0, G(i0.9) = 0.0 - i0.5; 

(b) G(i0.0) = 1.0 - i0.0, G(i0.3) = 0.307 - 0.6681, G(i0.6) = -0.122 - 0.391i, G(i0.9) 

= -0.158 - 0.175i, G(il.2)= -0.126 - 0.0773L 



Figure P5.1 


5.14 Tune the PID controller for the control system in Figure P5.1 and simulate the control 
performance for the step setpoint change. Here, G c2 (.v) = 4.0(1 + 0.3.S-), G p2 (.s) = exp 
(-0.2 s)/(s + 1), G p i(.y) = exp(-0.2.s’)A> + l) 3 . 



Figure P5.2 

5.15 Tune the PID controller for the control system in Figure P5.2 and simulate the control 
performance for the step setpoint change and the step input disturbance. 

(a) G ci (s) = 6.36(1 + 0.224s-), G p (,s-) = 2.0 exp(-0.1,s-)/(3,s- -1 )(.v + 1). 

(b) Gp(i-) = exp( — 0.2s) /s(s + l) 3 , G C i(j-) = 0.19. 
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Dynamic Behavior of 
Closed-Loop Control Systems 


It is important to predict the stability and the robustness to uncertainties in the case that a 
designed controller is applied to a process. This chapter defines the closed-loop transfer 
function and explains the relationship between the stability and the roots of the characteristic 
equation. Analysis tools for the Bode plot and the Nyquist plot are also introduced to predict the 
closed-loop stability by checking the open-loop transfer function. Also, the gain margin and the 
phase margin are defined to measure how much the closed-loop system is stable. 

6.1 Closed-Loop Transfer Function and Characteristic Equation 

A typical feedback control system has the structure shown in Figure 6.1. Here, u(s ) and y(.s) are 
the controller output and the process output respectively. y s (s) and cl(s) denote the setpoint and 
the disturbance respectively. d(s) and cljs) are called the input disturbance and the output 
disturbance respectively. G c (s) and G(,s) denote the transfer function of the controller and the 
process respectively. And G d (s) is the transfer function between the disturbance of cl(s) and 
the output disturbance of d Q (s). The step setpoint change means that y s (s) is a step signal. 
The step input disturbance and the step output disturbance means di(s ) and d„(s) are step 
signals respectively. 

6.1.1 Closed-Loop Transfer Function 

In Figure 6.1, the transfer function from y s (s) to y(s) is called the closed-loop transfer function 
between y s (s) and y(s) because the loop is closed. Meanwhile, the transfer function from e(s) to 
y(s) is called the open-loop transfer function because the loop is open. Consider the following to 
derive the closed-loop transfer functions. The closed-loop transfer function from y s (.s) to y(s) 
is (6.1) when the signals of d\(s) and d 0 (s) are zero: 

y(s) = G c (s)G{s)e(s) = G c (s)G{s)(y s (s )-y(s)) =► y(j) = (6.1) 
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Figure 6.1 Typical feedback control system. 


Equation (6.2) is the closed-loop transfer function from di(s) to y(s) when the signals of y s (s) 
and d Q (s ) are zero: 


y(s) = (G c (s)e(s) + d i (s))G(s) = G c ( J )G(j)(-y( J ))+^( J )G( J ) 
G(s) 


( 6 . 2 ) 


Equation (6.3) is the closed-loop transfer function from d(s) to y(s) when the signals of and 
di(s ) are zero: 


.v(.v) = G c (s)G(s)e(s) + d a (s) = G c (s)G(s)(-y(s)) + G d (s)d(s) =► y(s) = d ( s ) 

(6.3) 

By the superposition rule, the closed-loop transfer function from >> s (.y), d^s), d(s) to 
y(s) is 


. G c (s)G(s) 

* ) = l+G,WG M y - W ' 


G(s) 

1 + Gc(s)G(s) 


ck(s)- 


G d (s ) 

1 + G c (j)G(s) 


d(s) (6.4) 


6.1.2 Characteristic Equation 

Note that all three closed-loop transfer functions have the same denominator of 1 + G c (s)G{s). 
The characteristic equation is defined as 1 + G c (s)G(s) = 0. The roots of the characteristic 
equation correspond to the poles of the closed-loop transfer functions. So, the roots characterize 
the closed-loop dynamics and stability. If the real parts of all the roots are negative or a single 
root is located on the zero, then the closed-loop system is stable. If one of the real parts of 
the roots is positive or there is a multiple root (such as a double root, triple root, etc.) located on 
the zero, then the closed-loop system is unstable. 
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Figure 6.2 PI control system. 


Example 6.1 

Consider the control system in Figure 6.2. 

The characteristic equation of Figure 6.2 is 

1 + L5 ( 1 + 3~ky) = 0 => < s + + L5 * + 1 / 3 = 0 ( 6 - 5 ) 

The roots are —2.103, —0.369 + 0.927i, —0.369 — 0.927i and —0.159, which can be 
straightforwardly calculated by the roots function of the MATLAB function (i.e. roots 
([1 3 3 2.5 1/3])). The real parts of all the roots are negative. So, the closed-loop system of 
Figure 6.2 is stable. Also, the two roots show nonzero imaginary parts. So, the closed-loop 
system will show an oscillatory response. For detailed descriptions on the relationship between 
the poles and the response of the process, refer to Chapter 3. 

6.2 Bode Stability Criterion 

Chapter 3 explains how to draw the Bode plot and Nyquist plot for the given process. In this 
section, the Bode plot and Nyquist plot are used to analyze the stability of the closed-loop 
control system. If the signals of the closed-loop control system diverge as time increases, then 
the system is called unstable. If all the signals converge, then it is called stable. The system is 
called marginally stable if the signals show continuous cycling. 

Consider the typical control system in Figure 6.3. Flere, the transfer function from y s (s) to y(s) 
is called the closed-loop transfer function, denoted by G C l(^)- Meanwhile, the transfer function 
from e(s) to y(s) is called the open-loop transfer function, denoted by G 0 ^(s) = G c (s)G(s). 



Figure 6.3 Block diagram of a typical closed-loop control system. 

The Bode plot of the open-loop transfer function G 0 ds) = G c (s)G(s) can be used to analyze 
the stability of the closed-loop control system in Figure 6.3. Consider the following Bode 
stability criterion. 

6.2.1 Bode Stability Criterion 

Gods) is strictly proper and has no unstable poles. Also, G OI (.y) has only a single critical 
frequency w c and a single gain crossover frequency w g . Then, the closed-loop control system in 
Figure 6.3 is stable if IG OI (i<u c )l < 1. Otherwise, it is unstable. Here, the critical frequency 
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(phase crossover frequency) a> c is defined as <d c that satisfies /Goiiiai) = —n. The gain 
crossover frequency co g is defined as (o that satisfies IG 0 j/iw)l = 1. 

A rigorous proof of the Bode stability criterion is omitted in this book. Instead, the Bode 
stability criterion can be understood conceptually by the following arguments. Note that the 
statements below are conceptually right. Strictly speaking, they are not complete from the 
mathematical point of view. 

Let us start from Iteration 0 with the assumption of y s (f) = 0. Iteration 0: assume that 
e(t) — sin(w c t). Then, y(t) becomes y(t) = —IGoL(iw c )l sin(w c t) because e{t) = sin(w c t) goes 
though the process dynamics that satisfy /G 0 j/i<u c ) = — n. Then, e(t) = IG OI (iw c )l sin(m c f). 
Iteration 1: y{t) becomes y(t) = —IG OI (i<w c )l 2 sin(m c f) because e(t) = IG 0 L(i w c)l sin(w c t) goes 
through the process dynamics. Then, e{t) = IG OL (iw c )l 2 sin(&> c f). Iteration 2: y(t) becomes 
y{t) = — IGo L (itu c )l 3 sin(w c 0 because e(t) = IG OI (ioj c )l 2 sin(w c t) goes through the process 
dynamics. Then, e{t) = IG OI (iw c )l 3 sin(<u c t). So, y(t) exponentially diverges if IG OL (i« c )l > 1. 
y(t) exponentially converges if IG OI (i<u c )l < L If IG OI (i<Mc)l = 1, then the magnitude of y(t) 
does not change (marginally stable). 

Example 6.2 

Consider the control system in Figure 6.4. 


exp(-0.2s) 

(s+1) 3 


y(s) 




Figure 6.4 P control system. 

The open-loop transfer function is GoiX?) = k c exp(— 0.2s)l{s + l) 3 . Then, the following 
equations are obtained: 


/G OL (i«c) = - 0.2« c - 3tan -1 (w c ) = - 77 => m c = 1.408 (6.6) 

I G olM = (1+ ^ )3 /2 ^ l G o L (i«c)| = (6.7) 

The Bode plot of G 0 l(i w ) with respect to k c is shown in Figure 6.5. The scales of the y-axis 
and the x-axis are logio(IG OT Xiw)l) and logi 0 («) in the amplitude ratio plot. The scales of the 
y-axis and the x-axis are /G OL (iw) and logio(w) in the phase-angle plot. For detailed 
descriptions on how to draw the Bode plot, refer to Chapter 3. 

From (6.7) and Figure 6.5, it is concluded on the basis of the Bode stability criterion that 
the control system of Figure 6.4 is stable if k c < 5.151, unstable if k c > 5.151 and marginally 
stable if k c = 5.151. Figure 6.6 shows the simulation results of the control system in Figure 6.4. 
It confirms that the Bode stability criterion is correct. As expected, the frequency of 
the oscillation (marginally stable) for k c = 5.151 is w c = 1.408 (equivalently, the period 
is 2n/o) c ). 
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Figure 6.6 Simulation results of the P control system of Figure 6.4. 

Example 6.3 

Consider the PID control system in Figure 6.7. 

The open-loop transfer function is G 0 l(l) = 2.5[1 + l/(2.7^) + 0.6755] exp(—0.1.?)/ 
(5 + l) 3 . The Bode plot of G Q \ (s) is shown in Figure 6.8. 

The Bode plot shows that the control system is stable. Figure 6.9 shows the response of the 
control system of Figure 6.7 for the step setpoint change, which confirms that the Bode stability 
criterion is correct. 















Figure 6.8 Bode plot of the PID control sys 


of Figure 6.7. 
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Figure 6.9 Simulation results of the PID control system of Figure 6.7. 


6.3 Nyquist Stability Criterion 

The Nyquist plot of the open-loop transfer function G OI (.y) = G c (s)G(s) can be used to analyze 
the stability of the closed-loop control system, as with the Bode plot. Consider the following 
Nyquist stability criterion. 

6.3.1 Nyquist Stability Criterion 

GolC?) is strictly proper and has no unstable pole-zero cancellations. The Nyquist plot of GqlG ) 
encircles the (—1,0) point N times in the clockwise direction (N is negative for counterclock¬ 
wise). Let P be the number of RHP poles of G OI (.s). Then, Z = N + P is the number of RHP roots 
of the characteristic equation. The closed-loop system is stable if and only if Z= 0. 

Figure 6.10 shows the Nyquist plot for the control system in Figure 6.4. For detailed 
descriptions on how to draw the Nyquist plot, refer to Chapter 3. 

P = 0 for the P control system of Figure 6.4 and the Nyquist plot encircles (—1,0) one time 
(N = 1) if k c > 5.151. So, Z =N + P = 1 for k c > 5.151, which means that the control system is 
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Figure 6.10 Nyquist plot for the control system of Figure 6.4. 

unstable by the Nyquist stability criterion. N= 0, P = 0 and Z= N + P = 0 for k c < 5.151. So, 
the control system is stable for k c < 5.151 by the Nyquist stability criterion. 

Figure 6.11 shows the Nyquist plot for the control system in Figure 6.7. 

P = 0 for the PID control system of Figure 6.7 and N= 0 as shown in Figure 6.11. So, the 
control system is stable by the Nyquist stability criterion. The same conclusion as that of the 
Bode stability criterion is obtained. 



Re(G 0L ) 

Figure 6.11 Nyquist plot for the control system of Figure 6.7. 


Example 6.4 

Consider the control system in Figure 6.12. 

The open-loop transfer function is G 0 l(A) = 3 exp(—0.3s)/(3s — 1). The MATLAB code to 
plot the Nyquist plot of the open-loop transfer function, the Nyquist plot and the simulation 
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\ exp(-0.3s) | L(s) 


Figure 6.12 P control system. 

result of the closed-loop control system of Figure 6.12 are shown in Table 6.1, Figures 6.13 
and Figure 6.14 respectively. Note that G OI (.y) has one RHP pole and the Nyquist plot starts at 
the (—3, 0) point and encircles the (—1, 0) point in the counterclockwise direction. That is, 
P = 1 and N = — 1. Then, on the basis of Z=N + P = 0, it can be concluded that the control 


Table 6.1 MATLAB code to plot the Nyquist plot of Example 6.4. 


nyqufii^ _exl. m 

clear; 

w_max=30.0; delw=0.01; 

n=round(w_max/delw); 

w=0; G=g_nyquist_exl(w); m=l; 

W (m) =w; R (m) =real (G) ; 

I (m) =imag (G) ; 
for m=2:n 

G=g_nyquist_exl(w); 

W(m)=m*delw; R(m)=real(G); 
I(m)=imag(G); 
end 

figure (1) ; plot (R, I) L 


g_nyquist_exl.m 
function [g]=g_nyquist_exl(w) 
s=i*w; 

g=3.0*exp (-0.3*s) / (3*s-ij:; 


command window 
» nyquist_exl 



Figure 6.13 Nyquist plot for the control system of Figure 6.12. 
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Figure 6.14 Simulation results of the P control system of Figure 6.12. 


system is stable. The simulation result of the control system in Figure 6.14 confirms that the 
Nyquist stability criterion is correct. In this case, the Bode stability criterion cannot be applied 
because the open-loop process has an unstable pole. 


6.4 Gain Margin and Phase Margin 

The gain margin (GM) and the phase margin (PM) are quantitative measures to indicate how 
much the control system is stable. GM is defined as the reciprocal of the amplitude ratio of the 
open-loop transfer function at the critical frequency. That is, GM = l/IG 0 L(i w c)l- PM is defined 
as the phase difference between —n and the phase angle of the open-loop transfer function at the 
gain crossover frequency. That is, PM = /Goring) + n. The control system is more stable as 
GM and PM increase. 

Figures 6.15 and 6.16 show GM and PM in the Bode plot and the Nyquist plot. 
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Figure 6.15 GM and PM in the Bode plot. 



Re(G 0L ) 

Figure 6.16 GM and PM in the Nyquist plot. 


Example 6.5 

Estimate the GM and the PM for the control system in Figure 6.4 with k c = 2.151. 

Solution The open-loop transfer function is G 0 \ (s) = 2.151 exp(—0.2.s)/(.s' + l) 3 . Then, the 
critical frequency is obtained by solving 

/GoL(iwc) = — 0.2<o c — 3tan _1 (cu c ) = — 77 or Im(GoL(i«tc)) = 0.0 => w c = 1.408 (6.8) 
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And, the gain crossover frequency is obtained by solving 
2 151 

|G ° L(iWg)l = (l +t0 2)3/2 = 1=>ft »g = °- 8164 (6-9) 

Because IG OL (iw c )l = 0.4176, GM = l/IG OL (iw c )l = 2.3945. /G OL (ift> g ) = arctan 2(-0.7981, 
—0.6023) = —2.2173 is obtained from G OL (iaj g ) = —0.6023 — i0.7981. So, PM = — 2.2173 A 
71 = 0.9243 = 52.96°. 

Example 6.6 

Estimate the GM and the PM for the control system in Figure 6.7. 

Solution The open-loop transfer function is GolCs , ) = 2.5[1 + + 0.675s] exp- 

(—0.l5)/(5 + l) 3 . Then, the critical frequency is obtained by solving 

Im(Go L (u» c )) = 0.0 => w c = 3.836 (6.10) 

And the gain crossover frequency is obtained by solving 

|G OL (i<w g )| = 1 => <n g = 0.936 (6.11) 

Because IGol(uo c )I = 0.1078, GM = l/IG OL (iw c )l = 9.278. /G OL (i«g) = arctan2(—0.8532, 
—0.5208) = —2.1188 is obtained from G OL (itUg) = —0.5208 — i0.8532. So, PM= —2.1188 -f 
7t= 1.0228 = 58.60°. 

Problems 

6.1 Obtain the characteristic equation for the control system in Figure P6.1 and determine if it 
is stable or unstable. Also, explain the effects of the parameters of the PID controller on the 
stability of the closed-loop system. Here, the process is GpG) = 1/(5 + l) 4 . 




(a) G c (j) = 

(b) G c (j) = 

(c) G c (s) = 

(d) G c (s) = 
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6.2 Determine if the closed-loop system of Figure P6.1 is stable or unstable using the Bode 
and Nyquist stability criterion. If it is stable, find the GM and PM. 

gp( - 0 f ) , G c (s) = 1.5 
exp(-0.5s)(l + 0.2s) 

(*+l| 

exp(— 0.5s) 

(*+i ) 2 

exp(— 0.5s) 


(a) 

G P (s) = 

(b) 

= 

(c) 

G P (s) = 

(d) 

G P (s) = 

(e) 

G P (s) = 

(f) 

Gp.(j) = ‘ 


G e (s) = 10.0 


(s+iy 
exp(-0.5s)(l + 0.5s) 

(s+if r/ 

exp(— 0.2s) 

.IfpSlF’ 


G c (s) = 1.5(1+0.5s) 


G ^= 2 '°( 1+ 3tS +0 ' 71 ) 


G c (s) = 0.19 

6.3 Determine if the closed-loop system of Figure P6.1 is stable or unstable, 
(a) GcW = 6360+0.224,) 


6.4 Simulate Problem 6.2 and confirm if the closed-loop response coincides with your 
expectation. 

6.5 Simulate Problem 6.3 and confirm if the closed-loop response coincides with your 
expectation. 
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7.1 Cascade Control 

Cascade control uses an additional internal feedback loop to reject disturbances more 
effectively. The typical structure of a cascade control is shown in Figure 7.1a. It is composed 
of a primary (master) controller G ci (s) and a secondary (slave) controller G c2 (s). G p , (s) and 
G p2 (s) are the primary process and the secondary process respectively. The output > j 2(-v) of the 
secondary process G p2 (s ) is measurable, u t (s) and « 2 (s) are the control outputs of the primary 
controller and the secondary controller respectively. y s i (s) and y s2 (s) are the setpoints of the 
primary controller and the secondary controller respectively. Note that the control output of the 
primary controller is the setpoint of the secondary controller; that is, Ui(s) = y s2 (s). 

In Figure 7.1a, the disturbance d(t) directly affects y 2 {t). Meanwhile, d(t) indirectly affects 
yi(0 because it goes through the dynamics of G p i(s). The cascade control system in Figure 7.1a 
can detect the disturbance more quickly by measuring y 2 (t), compared with the conventional 
control system in Figure 7. lb. If the dynamics of G p2 (s) are fast, then the internal feedback loop 
(the secondary controller) can reject the disturbance quickly before the disturbance affects 
y\(t), resulting in an improved disturbance rejection performance. Meanwhile, the conven¬ 
tional control system inevitably shows a slow response to the disturbance because it measures 
only y\(t). The following three conditions should be satisfied for a successful cascade control: 

1. The output of the secondary process y 2 (s) is measurable. 

2. The disturbance affects the output of the secondary process y 2 (s) more quickly than the 
output of the primary process yi(s). 

3. The dynamics of the secondary process are fast enough for the secondary control action to 
remove the effect of the disturbance quickly. 

Figure 7.2 compares a conventional PID controller and cascade control, wherein G p i(s) = 
exp(—0.l^)/(w + l) 3 , G p2 (s) = exp(—0.1s)/(0.5s + 1), G cl (s) = 2.5(1 + 1/2.7.? + 0.675s), 
G c2 (s) = 5.0 and d(s) = 1/s. As shown in Figure 7.2, the cascade control rejects the disturbance 
more quickly than the conventional control because u 2 (t) of the cascade control quickly 
attenuates the disturbance. 
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primary controller 



Figure 7.3 shows a typical cascade control for an exothermic batch reactor, where TT and TC 
represent the temperature transmitter and the temperature controller respectively. The input 
and the output of the primary process arey 2 (i) and y i ( t) respectively. u 2 (t) andy 2 (t) are the input 
and the output of the secondary process respectively. 

In Figure 7.3, the disturbance is the temperature variation of the cooling water. This directly 
affects the temperature y 2 (f) of the cooling water in the jacket. u 2 (t) affects y 2 (t) quickly. So, the 
secondary controller can reject the disturbance quickly before the disturbance affects yi(f), 
resulting in excellent disturbance rejection performances. 

Example 7.1 

Simulate the cascade control system of Figure 7.2. 

Solution The MATLAB code to simulate Figure 7.2 is shown in Table 7.1. 


7.2 Time-Delay Compensators 

If the time delay of the process is long, then there is no choice but to wait as long as the time 
delay to detect the effects of the present control action on the process output. Then, an 
aggressive control action is not possible because there is no chance to correct the side effects 
of the aggressive present action for the long time. So, the time delay is one of the most serious 
bottlenecks in improving control performance. Fortunately, if a model is available, then the 
effects of the present control action on the future process output can be predicted without 
waiting as long as the time delay by solving the differential equation of the model using a 
computer. In this section, the two approaches of the Smith predictor (Smith, 1957) and the 
decoupled predictor (Sung and Lee, 1996) for the time-delay compensation are introduced. 

7.2.1 Smith Predictor 

Consider the control system shown in Figure 7.4, where G*{s ) is the time-delay-free process 
and G£,(s) is the time-delay-free model. G(s) = exp (—Os)G*(s) is the process. G c (s) is usually 
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the PID controller. The model output yjj, (s) is the simulated time-delay-free process output. 
That is, y^(s) corresponds to y*(s) = G*(s)u(s). If the model is exact (that is, G* m (s) = G*(s) ), 
then this is equivalent to control of the time-delay-free process, as shown Figure 7.5. 



Figure 7.5 An equivalent control system to Figure 7.4. 


Here, the process output is the delayed time-delay-free output; that is, y{t) = y*{t — 6). Note 
that the controller G c (s ) uses the signal y*(.s) rather than y(s). Then, it is possible to detect the 
effects of the present control action on the process output without waiting as long as the time 
delay. So, the controller can be tuned strongly because there is no time delay in the feedback 
loop, resulting in fast closed-loop responses. 

Practically, because there are always modeling errors, a feedback loop to compensate for the 
modeling error should be included, as shown in Figure 7.6. The feedback loop decreases the 
setpoint as much as the modeling error, resulting in no offset. 



Having obtained the Smith predictor in Figure 7.6, how is it tuned? The following 
characteristic equation of the Smith predictor can be easily derived from Figure 7.6: 

1 + G c (j)G^(j) + G c (j)(G p (s) - G m (s)) = 1 + G c (s)(G?(j) + G p (s) - G m (s)) = 0 (7.1) 

where G(s) = exp(— 6s)G*(s) and G m (s) = exp(—0 m ,y) G* n (s) are the process and the model 
respectively. If no modeling error is assumed (that is, G p (s)—G m (s) = 0), then the controller G c (s) 
should be tuned on the basis of the time-delay-free model G^(s). Note that G* m (s) has no time 
delay. Then, infinite controller gains will be assigned to G c (s) by the usual PID tuning rules if 
G^(s) is a low-order model. Clearly, the infinite gains are not desirable, because the huge gains 
will destabilize the closed-loop system by amplifying the modeling error, as shown in (7.1). For a 
reasonable tuning, the modeling error should be considered. Lee et al. 1999 approximate 
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GJ), (5) + G p (.s') — G m (5) in (7.1) to the equivalent gain plus time delay like G* m (5) + G p (s) — 
G m (5) ~ G* m (s)k cq exp(—0 cq s) to consider the modeling error. Then, reasonable controller 
gains by applying the usual PID tuning rules to A: eq G^(5 , )exp(—0 eq 5), k eq >1.0 and 0 eq > 0.0. 
k eq and 6 eq are adjustable parameters for the tuning of the Smith predictor. A more conservative 
controller will be obtained as the equivalent gain and the equivalent time delay are increased. 
In the implementation step, it is recommended to use ^ eq G^(5) and k eq G* m (,sjexp(— (0 m + 6 eq )s) 
for the time-delay-free model and the process model of the Smith predictor in Figure 7.6. 
The recommendation is for a conservative operation of the Smith predictor. 

The Smith predictor shows a good setpoint tracking performance because G c (s) is strongly 
tuned and the time-delay-free model output is used. Note that (7.1) becomes 1 + G c (5) G* m (5) = 0 
if there are no modeling errors. So, it is clear that G c (s) can be strongly tuned because G* m (5) has no 
time delay. But, it should be noted that the modeling error of G p (.s) — G m (s) is amplified by the high- 
gain controller of G c (s), as shown in (7.1). As a result, the closed-loop stability tends to be very 
sensitive to the modeling error G p (.s) — G m (s). Then, a small modeling error can make the closed- 
loop system unstable. 

In summary, the Smith predictor can provide an excellent setpoint tracking performance if 
the process model is accurate. But, a small model error can destabilize the closed-loop system 
if the gains of the controller are tuned too strongly. The Smith predictor can be tuned in a 
reasonable way by considering the modeling error in the form of the equivalent gain plus time 
delay. 


Example 7.2 

Simulate the Smith predictor of Figure 7.6 with G(s ) = exp(— 1 ,8s)/(s 2 + 2s + 1), G m (s) = 
0.95exp(— l.7s)/(s 2 + 2.2s + 1). Assume 7% modeling error for the equivalent gain and 
equivalent time delay; that is, G^(5) + G p (s) — G m (s) « G f m (s) 1,07exp(— 1.7 x 0.075). Com¬ 
pare the Smith predictor with the conventional PID controller. 

Solution G* m {s) 1.07exp(—1.7 x 0.075) = 0.95 x 1.07exp(-1.7 x 0.075)/ (s 2 + 2.25+ 1) 
should be used to tune the PID controller of the Smith predictor. Then, the ITAE-2 tuning rule 
provides G c (s) = 8.455(1 + 1/2.2705 + 0.4565), and G m (s) = 0.95 x 1.07 exp(—1.7 x 1.075)/ 
(s 2 + 2.25 + 1) and G*^ (5) = 0.95 x 1.07exp(—0.05)/(5 2 + 2.25+ 1) should be used for 
the models of the Smith predictor. The conventional PID controller designed by the ITAE-2 
tuning rule based on the model G m (5) = 0.95 exp(—1.75)/(5 2 + 2.25 + 1) is G c (s)= 1.027(1 + 
1/2.5605 + 0.7515). The MATLAB code for simulation and the simulation results are shown 
in Table 7.2 and Figure 7.7 respectively. Note that the closed-loop response is very fast because 
the parameters of the PID controller of the Smith predictor can be tuned strongly, whereas the 
conventional PID controller shows a slow closed-loop response, as shown in Figure 7.6. 


7 . 2.2 Time-Delay Compensator with Decoupled Control Structure 

The high-gain controller of the Smith predictor amplifies the modeling error, possibly, resulting 
in unstable closed-loop responses for small errors. To overcome the problem, the amplication 
phenomenon by the high-gain controller should be removed. The time delay compensation 
with decoupled control structure can be a good candidate to solve the problem (Sung and 
Lee, 1996). 
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Table 7.2 MATLAB code to simulate the Smith predictor. 

smith_exl .rn 

clear; 

tf=15; delt=0.01; u=zeros (^$00) 

x=zeros(2,1) ; xm=zeros (2,1) ; xm_free=zeros(2,l); 

tf_k=round(tf/delt+0.0000001); 

s=0.0; ys=1.0; ysb=0.0; y=0.0; yb=0.0; 

ym=0.0; ymb=0.0; ym_free=0.0; ymb_free=0.0; 

kc=8.455; ti= 2.270; td= 0.456; %Smith 

:.kc-l .027; bi- 2.560; td= O^l; %Conventional PID 

for k=l: tySJc 

t=(k-1)*delt; T(k)=t; Y(k)=y; Ys(k)=ys; C(k)-u (500); 

-’Seif 1=1: 4 99 u (i) =u ) ; end 

e_pid=ys-y+ym-ym_free; 
eb_pid=ysb-yb+ymb-ymb_free; 
s=s+(kc/ti)*e_pid*delt; 

.Sa (500) =kc*c_p i d-s-kc* fd* (e_pid-eb_pid) /delt; 
yb=y; ymb=ym; ymb_free=ym_free; ysb=ys; 

% Remove the below two lines for the conventional PI® 

[xm,ym]=smith_model_exl(xm,delt,u); % model 

[xm_free,ym_free]=smith_model_delay_free_exl(xm_free,delt,u); 
[x,y]=smith_process_exl(x,delt,u); % process 
end 

figure (1) ; plot (T, Ys,’®,T) ; hold ofj; 

%figure (1) ; plot(T,Y); hold on; 
figure (2); plot(T,U); hold on; 


sir.itr._process_exl .m 

smith_model_exl .itf. 

function [next_x,y]=smith_process_ 

function 

exl(x,delt,u); 

[next_x,y]=smith_model_ 

subdelt=delt/5; n=round(delt/ 

exl(x,delt,u); 

subdelt); 

subdelt=delt/5; n=round(delt/ 

A= [ 0 — 1 ; 1 -2.0 ] ; B= [ 1.00; 0:.] ; C= [ 0 1 ] ; 

subdetl.J-j 

delay=l.80; 

A=[0 -1; 1 -2.2] ; B= [0.95*1.07; 0] ; 

delay_k=round(delay/delt) ; 

,fi=[0 1]; delay=l.7*1.07; 

for i=l: n 

delay_k=round(delay/delt 

dx=A*x+B*u(500-delay_k); 

+0.00001); 

x=x+dx*subdelt; 

fo|ji=l:n 

end 

dx=A*x+B*u(500-delay_k); 

next_x=x; y=C*x; 

x=x+dx*subdel||/ 

return 

end 


next_x=x; y=C*x; 


return 

SttlSh_model_delay_free.m 

command window 


» sir.i th_ex". 

function 
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Table 7.2 ( Continued) 



delay_free_exl(x 

delt,u); 

subdelt=delt/5; n 

-round(delt/ 

subdelt) f- 


A= [0 -4* 1 -2.2] ; 

1] ; 

= [0.95*1,07; 0] ; 

for i=l: n 

dx=A*x+B*u 

500.); 

x=x+dx*subc 

elt; 

end 


next_x=x; y=C*x; 


return 




1.2 

,-- X 


0.8 






0.6 



0.4 

t / 

i j -y(t)-Smith predictor 


0.2 

j/ .^^-conventional PID 


Q 

? 


( 

5 10 15 

t 




0 

/' - ' V ' 



i u(/)-Smith predictor 



[ ......... ^-conventional PID 


-5 

- 





" 10 c 

5 10 1 

5 

Figure 7.7 Control performances of the Smith predictor and the conventional 

PID controller in 

Example 7.2. 














Enhanced Control Strategies 


223 


Consider the control structure shown in Figure 7.8. This is composed of two PID 
controllers, a time-delay-free model and a process model, where y(s), and y* m (s) denote 
the process output, the model output and the time-delay-free model output respectively. d(s) is 
the input disturbance. The left-hand side is for the setpoint change. y m (,y) corresponds to the 
process output by the setpoint change and then y(s) — y m (.s) corresponds to the process output 
by the disturbance. So, G c s (s), for which the setpoint is >’ s (.v), controls the time-delay-free 
model output of (s ). G cd (.y), for which the setpoint is zero, rejects the disturbance and the 
modeling error. 



Consider the two closed-loops in Figure 7.8. Clearly, the two closed-loops are decoupled from 
the stability point of view. The first closed-loop for the setpoint change includes only G c s (s) and 
(5) and the characteristic equation is 1 + G C)S (,y)G l t n (,y) = 0. So, the controller G c%s (,y) should 
be tuned on the basis of G* m (s). Then, the tuning parameters would be strongly tuned because 
G* m (s) is the time-delay-free model. Meanwhile, the second closed-loop for the disturbance 
rejection includes only G Cj d(s) and G p (.s) and the characteristic equation is 1 + G cd (.s)- 
Gp(.y) = 0. So, the controller G c d (,y) should be tuned on the basis of the process model G m (s). 
Then, the controller G c d (.s) would be tuned in a conservative way because G m (.s) includes 
the time delay. Now, it is clear that the amplication phenomenon of the modeling error 
(Gp(.v) — G m (s)) by the high-gain controller in the Smith predctor is completely removed 
by the control structure of Figure 7.8 because it manipulates the disturbance rejction using a 
low-gain controller G c d (s). It is concluded that the time-delay compensator of Figure 7.8 is 
superior to the Smith predictor of Figure 7.6. 

Example 7.3 

Simulate the Smith predictor and the decoupled time-delay compensator of Figure 7.8 with 
G(s) = exp(— 1 ,95s)/(s 2 + 2s+ 1), G m (s) = 0.95 expf-1.7.y)/(,y 2 + 2.2s + 1). Assume 3% 
modeling error for the equivalent gain and equivalent time delay; that is, G* m (s') + G p (s) — 
G m {s) w C4(s)1.03exp(—1.7 x 0.03i). 

Solution G^(j)1.03exp(-1.7 x 0.03 j) = 0.95 x 1.03exp(-1.7 x 0.03s)/(,s 2 + 2.2^+ 1) 
is used to tune G CjS (j) in Figure 7.8 and G c (.s) in Figure 7.6. Then, the ITAE-2-setpoint 
tuning rule provides G c (s) = 18.29(1 + 1/2.265.S + 0.436.S) for Figure 7.6 and G c Js) = 18.29 
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(1 + 1 /2.265.S' + 0.4365) for Figure 7.8, and G m (s) = 0.95 x 1.03 exp(—1.7 x 1 .03s)l(s 2 + 
2.25 + 1) and G^(5) = 0.95 x 1.03exp(—0.05)/(5 2 + 2.25+ 1) are used for the models in 
Figures 7.6 and 7.8. G cc i(5) designed by the ITAE-2-disturbance tuning rule based on the 
modelG m (5) = 0.95 x 1.0exp(-1.7 x 1.035j/(5 2 + 2.2s + l)isG c (5) = 1.261(1 + 1/2.3705 + 
0 .8785). The MATLAB code for simulation is shown in Table 7.3. Figure 7.9 confirms a poor 
robustness of the Smith predictor to the modeling error. The decoupled time-delay compensa¬ 
tor of Figure 7.8 shows acceptable robustness because the setpoint tracking problem and the 
disturbance (modeling error) rejection problem are decoupled. 


Table 7.3 MATLAB code to simulate the decoupled time-delay compensator in Example 7.3. 
delay_compensator_exl.m 

tf=20; delt=Q>005; tf_k=round(tf/delt+0.0000001); 
cont_cmti=zeros (1,500) ; %control ouputl 
cont_out2=zeros (1,500) ; %ccni.ro 1 ouput2 
xl-zeros(2,1 ) ; x2 = zeros(2,1) ; x3=zeros(2,1); 
y=0.0; yb=0,0; sl=0.0; ysei#:|^0; ysb=0.0; ys=0. Q# 
ym=0.0; ymb=0.0; ym_star=0.0; ymb_star=0.0; s2=0.0; 
kcl=18.285; til= 2.265; tdl= 0.436; 

Us£-%.261; 0f=2.37O; td2=0.878; 
for k=l: tf_k 

t=(k-l)*delt; T(k)=t* XI (k)=ym; Y2(k)=y; 
ys=yset; Ys(k)=ys; Il(k)=sl; I2(k)=s2; 

, U1 (k) =>cont_outl (500) ; 

U2 (k)=cont_out2(500) ; 
for 1=1:4 99 

con 4 _ouul(i)=cont_outl(i+1); 

cont_out2(i)=cont_out2(1+1); 
end 

sl=sl+(kcl/til)*(ys-ym_star)*delt; 

cont_outl (500)=kcl* (ys-yn_st.a r) +si+kp'. *t.d". * (ys-ym_star-ysb+yttib_, 
star)/delt; 

s2=s2+ (kc2/ti.2;) * t^m-y) *de..tW; 

cont_out2(500)=kc2*(ym=y)+s2+kc2*td2*(ym-y-ymb+yb)/delt+cont_outl 
(500) ; 

ymb=ym; ysb=ys; yb=y; ymb_star=ym_star; 

[x2, y] =compensator_process_exl (x2, de lit, con l_o j 12) ; 

[xl,ym]=compensator_model_exl(xl,delt,cont_outl); 

[x3,ym_star]=compensator_model_star_exl(x3,delt,cont_outl); 
end 

figure (1) ; hold on; plot (T, Ys,T, Y2) 
figure (2); hold on; plot(T,U2) 


compensator_process_exl.m 
function 

[next_x,y]=compensator_ 
process_exl(x,delt,u); 
subdelt=delt; n=round 


compensator_model_exl.m 

fteofiidKf 

[next_x,y]=compensator_ 
model_exl(x,delt,u); 
subdelt=delt; n=round 
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Table 7.3 ( Continued) 


(delt/subdelt); 

(delt/subdelt); 

A= [ 0 4§§Jl -2.0]; B= [ 1.01- &f# 

A= [ 0 -1; 1 -2.2] ; B= [0.95*1.03; 0] ; 

C=[0 1] ; delay=l.95; 

C=[0 1] ; delay=l.7*1.03; 

boI ay_k-jround (delay/delt+ 

delay_k=round(delay/delt 

0.00001); 

+0.00001 )t 

for i=l: n 

for i=l: n 

dx=A*x+B*u(500-delay_k); 

dx=A*x+B*u(500-delay_k); 

x=x+dx* subdelt; 

x=x+dx*subdelt; 

end 

end 

next_x=x; yo=C*x; y=yo; 

next_x=x; yo=C*x; y=yo; 

return 

return 

compensator_model_star_exl 

command window 

f unction [next_x, y] = compensator 

» delay_compensator_exl 

model_star_exl(x,delt,u); 


subdelt=delt; n=round 


(delt/subdelt); 


A= [ 0 4J.J' 1 -2.2] ; B= [0.95*1.03; 0] ; 


t$=[0 1] ; delay=0; 


do I ay_k-fdur.d (delay/delt+ 


0.00001); 


fpr-i=l: n 


dx=A*x+B*u(500-de1ay_k); 


x=x+dx*subdelt; 


end 


next_x=x; yo=C*x; y=yo; 


return 



7.3 Gain Scheduling 

Gain scheduling is used to incorporate the variation of the process dynamics according to the 
variation of the operating region. For example, consider the following nonlinear process: 

^+y{t) = ku{t-o) ( 7 . 2 ) 

where k = k 0 + k\y(t), t = 2.2 + 0.1 u(t) and 6 is constant. Equation (7.2) is a nonlinear 
FOPTD process. It has a nonlinear static gain of k = k 0 + k\y(t), which is a function of the 
process output. Note that the static gain changes (not constant) when the process output 
moves from one operating region to another operating region, resulting in different dynamic 
behaviors. Then, how to tune the PID controller? Consider the IMC tuning rule in Section 5.4. 
This determines the proportional gain by kk c = (2 + 6)/2(a + 6). Then, the proportional gain 
is k c = (2 + 0)/2k(k + 6) = (2 + 0)/2(k o + k\y(t))(A + 6), which changes according to the 
operating region. This kind of setting is called gain scheduling. The same approach can be 
applied to a nonlinear time constant. That is, the IMC tuning rule provides the tuning 
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Figure 7.9 Control results of a decoupled time-delay compensator and a Smith predictor. 


parameters r,-= r + 0/2 = 2.2 + O.lw(f) + 0/2 because the time constant and the time 
delay of the process are 2.2 + 0.1 u(t) and 0. As a result, the PID controller with a gain 
scheduling of k c = [2(2.2 + OAii(t)) + 9]/2(k 0 + k iy (t))U + 0), t f = 2.2 + 0.1n(/) + 0/2 
should be used to control the nonlinear process of (7.2) to compensate for the nonlinearity 
of the process. 

Gain scheduling can be applied to the case where the nonlinearity of the process is described 
by a piece-wise function. For example, assume that the process is described by the piece-wise 
FOPTD model of the following three equations: 

k= l, t=1 , 0 = 0.2 fory(f) < 0.2 


k = 1.2, t = 0.9, 0 = 0.3 for0.2<y(/) <0.4 

k = 1.5, t = 0.7, 0 = 0.35 for 0.4 < y(t) 


(7.3) 

(7.4) 

(7.5) 
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Then, the following three tuning parameter sets by the IMC tuning rule with X = 0.250 should 
be used: 


k c = 4.4, Ti = 1.1, T d = 0.091 fory(f) < 0.2 (7.6) 

kc = 2.33, ^ = 1.05, r d = 0.129 for0.2 < y(t) < 0.4 (7.7) 

k c = 1.373, Ti = 0.875, r d = 0.140 for0.4<y(f) (7.8) 


Example 7.4 

Simulate the control performance of a PID controller with gain scheduling for the following 
nonlinear process for the unit step setpoint change: 

(1 — 0.1y(f)) +y(t) = (1 + 0.5y(t))u(t — 0.3) 

(7.9) 

Solution In (7.9), the time constant is t = 1 — 0. \y(t) and the gain is k = 1 
approximate them using the following piece-wise FOPTD model: 

+ 0.5y(t). Let us 

k = 1.1, t = 0.98, 0 = 0.3 fory(f) < 0.4 

(7.10) 

k = 1.3, t = 0.94, 0 = 0.3 for0.4<y(f) <0.8 

(7.11) 

k = 1.5, t = 0.9, 0 = 0.3 for 0.8 < y(t) 

(7.12) 


Then, the tuning parameters of the IMC tuning rule for the equations (7.10)—(7.12) are 
follows: 


k c = 2.739, 

Ti = 1.130, 

T d = 0.130 fory(t) < 0.4 

(7.13) 

k c = 2.236, ii 

= 1.090, T d 

= 0.129 for0.4<y(f) <0.8 

(7.14) 

k c = 1.867, 

Ti = 1.050, 

T d = 0.129 for0.8<y(f) 

(7.15) 


The MATLAB code to simulate the gain scheduling and the simulation results are shown in 
Table 7.4 and Figure 7.10 respectively. Note that the closed-loop response of PID control with 
gain scheduling is acceptable, whereas conventional PID control without the gain scheduling 
shows an oscillatory response. If the nonlinearity is severe, then PID control without gain 
scheduling may show an unstable closed-loop response. 
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Table 7.4 MATLAB code to simulate the PID control system with gain scheduling in Example 7.4. 

scheduling_exl.m 

g_scheduling_exl .rtij 

clear; 

function [dx_dt]=g_scheduling_ 

t=0.0; t_final=8.0; 

exl (y, x, u) 

x= [0] ; y=0.0; yb=0.0; ys=0.0; ysb=0 . O.f 

A= [— 1/(1-0.l*y) ] ; 

delta_t=0.005; n-round 

B= [( 1+0.5*y) / (1-0.l*y)]; 

(t JSnal/delta_t) ; 

dx_dt=A*x+B*u; 

C=[l] ; theta=0.3; % time delay 

end 

h_u=zeros(1,1000) ; n_theta=round 


(theta/delta_t) ; s=0.0; 


for if 1 : n 


t_array(i)=t; y^array(i)=y; 


ys_array ( i ) =ys ; 

command window 

if(t>l) ys=l ;'0|, else ys=0.0; end 

» scheduling_exl 

if (y<0.4 ) kc=2.739; t^.130; 


td=0.130; end 


if(0.4<=y&y<0.8) kc=2.236; 


ti=l.090; td=0.129; end 


if ( 0.8<=y) kc=l.867; ti=1.050; 


td=0.129; end 


% kc=2.739/Mfl\l30; td=0.130; 


% no gain scheduling 


s=s+ (kc/ti) * (ys-y)*delta_t; 


u=kc*(ys-y)+s+kc*td* ( (ys-y) - 


(ysb-yb) ) /delta_t; 


ysb=ys; yb=y; % one sampling before 


for : 999 h_u (j ) =h_u (j +1 ) ; end 


h_u(1000)=u; 


dx_dt=g_scheduling_exl(y,x,h_u 


(1000-n_theta) ); 


x=x+dx_dt*delta_t; y=C*x; 


t=t+delta_t; 


end 


figure (1) ; hold on; plot ( t_array. 


ys_array,t_array,y_array) ; 


%plot(t_array,y_array) ; 


figure(2); hold on; plot ( t_array. 


u_array) ; 


7.4 Proportional-Integral-Derivative Control using Internal 

Feedback Loop 


The structure of the PID controller is not appropriate to control an open-loop unstable process 

such as an integrating or unstable process (Sun 

g and Lee, 1996; Kwak et al. 2000). For 
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Figure 7.10 Control performances of the PID controller with gain scheduling and without gain 
scheduling in Example 7.4. 


example, consider the following control system composed of the integrating process (7.16) and 
the PID controller (7.17): 


<?(») = 


exp(—0.1s) 
s(s + 2) 


d 2 y(t) 0 d y(t) 

d f dt 


u(t- 0.1) 


(7.16) 


u{t) = *b(y.(0 -y(t)) + ~J Q (^( ? )-y(0) dt+k c x d d ( ys ^ dt (7.17) 


From (7.16) and (7.17): 

— f (>^(0-y(0)di = o.o 

T i Jo 

should be satisfied for the offset to be zero. This is true for all integrating processes. Now, 
imagine the closed-loop response for a positive step setpoint change. In that case, the final value 
of (y s (t) — y(t)) dt should be zero. But, the integral term from the starting time t = 0 and the 
rise time t = t r is inevitably a positive value (that is, J 0 r (y s (f) — y(t)) dt > 0.0) because perfect 
control is impossible. So, the integral term from the rise time t = t r to the final time t = °° should 
be negative (that is, J~(y«(f) —y{t))dt < 0.0) because 

f (}'s(f)-y(0)df = [ (y s (0-)'(0)dt+ [ (y s (f)-3'(0)df = O.O 

JO JO J t t 

should always be satisfied for an integrating process. This means that a large overshoot 
(equivalently, a large negative error) cannot be avoided. The same conclusion can be derived for 
an unstable process. Consider the following control system composed of an unstable process 
and a PID controller: 


G(s) = 


exp(-O.D) 

(s+l)(lQs-l) 


lof^W+s— 

dt 2 dt 


-y(t) = u(t- 0.1) 


(7.18) 


k 

— (>'^(f)-)'(f))dt + fc c T d 

Jo 


dCvsW-yM) 


u{t)=k c {y s {t)-y{t)) + 


(7.19) 






230 


Process Identification and PID Control 


From (7.18) and (7.19): 


&<*)-*$)*= - 1 

should be satisfied for the offset to be zero. So, the final value of JJ° (}’ s (() — y(t )) dt should be 
negative. Because the integral term at the starting time t = 0 to the rising time is a positive 
value (that is, Jg'CysM ~y(0) dt > 0.0), the integral from the rising time to the final time 
should be negative (that is, j“(y s (f) —y(t)) d t < 0.0) because 


| (.Vs(0 — v(0) dt = | (v s (0 -,v(f)) dt+ (y,(e) ->•(/)) dt = - ^ 

should be satisfied for an unstable process. This means that a large overshoot (equivalently, 
a large negative error) cannot be avoided. This case is worse than the case of an integrating 
process because a bigger overshoot is required to satisfy 


| (ys(t)-y(t))dt= - | o („y s (f). ~y(t)) dt — 


Until now, the structural limitation of a PID controller in controlling the open-loop unstable 
process is justified. 

Then, how to overcome the structural limitation? This can be solved easily by using an 
internal feedback control loop (Kwak et al., 2000). Consider the control system of Figure 7.11. 
The transfer function of the overall process is 


Coverall (■'*') — / . : 

u(s) 


G(s) 

1 + G(s)ki 


(7.20) 


In Figure 7.11, the input and the output of the overall process are u{s) and >’(.v) respectively. 
Note that the overall process composed of the open-loop unstable process and the internal 
feedback loop becomes an open-loop stable process. As a result, there are no more structural 
limitations. 


0-» PID(s) 




Figure 7.11 PID control using an internal feedback loop. 


The PID controller should be tuned on the basis of the overall process through the following 
procedure. First, the internal feedback loop should be tuned. For the integrating process, k\ can 
be tuned on the basis of the ultimate gain k u of the process (for example, k-, = kJA). The optimal 
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gain margin tuning rule in Chapter 5 can be used for the unstable process. Second, the PID 
controller should be tuned. To do that, the overall transfer function of G overa n(.s') = y(s)/u(s) = 
G(s)/( 1 + G(s)k\) should be reduce to an FOPTD or SOPTD model by the model reduction 
method. Finally, tune the PID controller using the usual tuning rules for the reduced FOPTD 
or SOPTD model. For a detailed description and examples of the tuning of a PID controller 
using an internal feedback loop, refer to Chapter 5. 


Problems 

7.1 Explain the conditions for cascade control to be successful. 

7.2 Consider the process of Figure P7.1. Determine if the cascade control is recommendable to 
the following cases. Here, yi(t) is measurable. 


(a) 

GplW 

(b) 

Gp2W 

(c) 

Gp2(j) 

(d) 

Gp2(5) 


exp(-O.D) 
s+ 1 

exp(—O.85) 
s + 1 

exp(—O.85) 
s+ 1 

10exp(—0.5s) 

O+i ) 2 


GptW = 


GpiM = 


Gpits) = 


G p i (s) = 


exp(—0.3 j) 
(*+l ) 5 
exp(-O.ls) 

(*+l) 2 

exp(-O.D) 
(^+1) 2 
exp(—0.5 j) 
Gv+i ) 2 


y 2 (t) is measurable 
y 2 (t) is measurable 
yg(i) is not measurable 
y 2 (t) is measurable. 


7.3 Design a cascade control system for the process in Figure P7.1 with 
G p2 (s) = exp(~0.1s)/(s + l) 2 and G pl (s) = exp(-1.0s)/(s + l) 3 and simulate the control 
performance for a step input disturbance. 



7.4 Design a Smith predictor for the process G(s) = exp(— 1 ,5s)/(s + l) 3 and simulate the 
control performance for a step setpoint change. 

7.5 Design the gain scheduling for the following nonlinear process and simulate the control 
performance for a step setpoint change: 

(a) (1 + 0.2y(0)^+y(0 = (1 + 1.5y(t))w(i —0.5) 

(b) (l+ O .ly(t)) 2 ^+2(l+O.ly(f))(l+O.5y(0)^+yW 

= (2.0 + u(t — 0.5))u(t — 0.5) 

7.6 Summarize the advantages of a Smith predictor and gain scheduling. 

7.7 Design the decoupled time-delay compensator for the process and the model of 
G^(^) = G m (s) = G p (s) = exp(—0.2 s)/(s+ l) 4 and simulate the control performances 
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for a step setpoint change and a step input disturbance rejection. In this case, it is not a time- 
delay compensator, but it must show good control performances for both the step setpoint 
change and the step input disturbance rejection. 

7.8 Design the decoupled time-delay compensator for the process G p (s) = exp(—1.0,s)/(s + l) 4 
and simulate the control performances for a step setpoint change. In this case, reduce the 
process using the model reduction method to obtain the SOPTD model. 

7.9 Design a PID controller and internal feedback loop for the process G m (s) = G p (s) 
= exp(— 1.5 s)/j(j + l) 2 and simulate the control performances for a step setpoint change 
and a step input disturbance rejection. 
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Part Three 


Process 

Identification 


Process identification methods, whose role is to provide the process model in designing the 
process controller, are introduced in Part Three. In Chapter 8, the mathematical tools of the 
Fourier series and describing function analysis are introduced, followed by the process 
identification methods of the Fourier analysis and the modified Fourier transform to estimate 
the process models in the form of the frequency response. Chapters 9 and 10 introduce the 
process identification methods used to obtain the process models in the form of a continuous¬ 
time differential equation and a discrete-time difference equation respectively. Chapter 11 
discusses how to convert the discrete-time model to a continuous-time model. 




8 


Process Identification Methods 
for Frequency Response Models 


A Fourier series is one of the most important representations for describing a periodic function. 
The Fourier series and Fourier transform have been widely used to identify process models. 
This chapter introduces several process identification methods to estimate the frequency 
response data of the process. 


8.1 Fourier Series 

The Fourier series is an important basic theory needed in deriving and analyzing process 
identification methods. In this section, the formulas to calculate the Fourier coefficients of the 
Fourier series are derived. 

Assume that the periodic function has a period p. It is proven that all the data of the periodic 
function can be represented by the following Fourier series (Kreyszig, 2006): 

f{t) = a 0 + [°« cos + b " sin ( 2 y ? )] ( 8 -!) 

where the coefficients are called the Fourier coefficients. Then, how to calculate the Fourier 
coefficients for the given periodic function? Let us derive the formula. 

Formula to obtain a 0 Let us integrate both sides of (8.1) from t = —pH to t = pll. Then, (8.2) 
is obtained: 
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It is straightforward to derive (8.3) from (8.2): 


J p / 2 ~ 1 [P /2 

f(t ) d t = pa 0 + xO + i„xO)^flo=- f(t ) d 

p/2 P J -p/2 


(8.3) 


Formula to obtain a,„,m= 1,2,... Let us integrate both sides of (8.1) from t = —p/2 tot = p/2 
after multiplying by cos(2mnt/p). Then, (8.4) is obtained: 



(8.4) 


Here, consider the following: 



So, (8.9) is obtained from (8.4): 
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Formula to obtain b m ,m= 1,2,... Let us integrate both sides of (8.1) from t = —pH to f = pH 
after multiplying by sin(2nmt/p). Then, (8.10) is obtained: 



(8.14) 


So, (8.15) is obtained from (8.10): 
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In summary, a periodic signal/(I) of which the period is p can be represented by a Fourier series: 

f{t) = a 0 + ^ |a„cos + b n sm | (8.16) 

where the coefficients of the Fourier series are estimated by the following formulas: 

«o = -[ f{t)dt = - \ f(t)dt (8.17) 

Pi-p/2 Pio 

a "=p\Z/ i ‘ ) ™Cir) d ' = l " = 1 ’ 2 '- (818) 

6 ' = r-r,V ( ' )si K^) rf ' = P -I/ < ' )si KT f )‘''' ” =1 ' 2 ' ■ <819) 

Example 8.1 

Represent the periodic signal shown in Figure 8.1 using a Fourier series. 



Solution Because u(t) is a periodic signal, it can be represented by the Fourier series (8.20) as 
follows: 

/ X /2ttA L ■ ( 2 ™\ 2ttA . / 2nA 

u(t) = ao + «tcos ^—J + 6isin ^—J + a 2 cos^2 x — J + b 2 sin^2 x — J + • • • 

(8.20) 

Because u(t) is an odd function, then 

“»= p[ u<,> '“ = °' “• = H" <,)cos (ir) = 0 

So, the Fourier series becomes 

. . , . /2jcA , . / 2nt\ , . / 2ttA 

u(t) = b\ sin I —J + b 2 sin 12 x —I + h 3 sin 13 x — J + ■■■ 


( 8 . 21 ) 
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The Fourier coefficients in (8.21) can be obtained by (8.19) as follows: 



Equation (8.22) can be rewritten as 



( 8 . 22 ) 


(8.23) 


Thus: 



So, the final form of u(t) is 


4 d 
2 nn 
4 d 
2 nn 


(cos(rat) — cos(O)] = —, 
nn 

[cos(rat) — cos(O)] = 0, 


n= 1,3,5,... 

(8.24) 

n = 2,4,6,... 


4 d 4 d 4 d 4 d 

u(t) = —sin(mf) + — sin(3<wt) + — sin(5wt) + — sin(7wt) + 


(8.25) 


where cd = 2nlp is the fundamental frequency of u(t). Figure 8.2 compares the original function 
of u{t) and the approximated function by the finite Fourier series of 


, , 4d . (2n\ 4d . / 2n \ 

u„(t) = —sin — t + — sin 3 — t H 
Jt \p ) 3tt \ P J 


I-sin n — t 


As the number of the terms increases, a better accuracy is obtained. 



Figure 8.2 Approximation results of a finite Fourier series. 
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8.2 Frequency Response Analysis and Autotuning 

Let us explain the conventional relay feedback method briefly before introducing frequency 
response analysis and autotuning. Figure 8.3 shows an activated process output by a conven¬ 
tional relay feedback method. 



Figure 8.3 Activated process output by a conventional relay feedback method. 


The procedure for process activation by relay feedback is as follows. First, the upper 
(on) value of the relay output is applied to drag the process output out of the initial value, 
as shown in Figure 8.3. Second, the lower (off) value of the relay is applied when the 
process output deviates from the initial state. Third, the upper value of the relay is applied 
when the process output is less than the reference value, and vice versa. That is, u{t) = d if 
y(t) < 0 and u(t ) = —d if y(t) > 0. Then, the process input and output usually reach a cyclic 
steady state (which means that the period and the peak value of the process output do not 
change) after three or four cycles. For a more detailed description on the relays, refer to 
Chapter 12. 

8.2.1 Frequency Response Analysis 

The objective of frequency response analysis is to estimate the frequency response (frequency 
model) of the process from the activated process input and the process output. For example, 
consider activated process data from a conventional relay feedback method, as shown in 
Figure 8.3. To estimate the frequency model of the process from the activated process input and 
output, the two signals of the relay output and the process output are approximated to two sine 
signals. As shown in (8.25), the square signal of the relay output in the cyclic steady state can be 
represented by a Fourier series as follows: 

u(t) = — sin(wt) + ^sin(3wt) + ^sin(5wf) + • • • (8.26) 

n 37t 5tt 

where w = 2jt lp r is the fundamental frequency. p r denotes the period of the relay. u(t) and 
d denote the relay output and the magnitude of the relay on-off respectively. If only 
the fundamental term is considered and the harmonics (higher frequency terms such as 
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4 d sin(3&U)/3jt, 4 d sin(5<wf)/5n,...) are neglected, then the following approximation is obtained: 
4 d 

u(t ) « —sin(wt) (8.27) 

Jt 

Also, a sine signal can approximate the process output as follows: 

y(t) « - asin(wf) = asin(a)t - Jt) (8.28) 

where y{t) and a denote the process output and the peak value of the process output respectively. 
Then, the process output can be said to be approximately y{t )« a sin(wt — jt) for the process 
input u{t) fts Ad sin(«J)/Jt. Then, it is clear that the phase angle between u(t) andy(f) is — Jt. So, the 
frequency a> is the ultimate frequency of the process. Also, it is clear that the amplitude ratio 
corresponding to the ultimate frequency co is approximately na/4d and the ultimate gain is the 
reciprocal of lid Ad. In summary: 

w u « a) = ^ and p a ss p r (8.29) 



where <w u , p u and k a denote the ultimate frequency, the ultimate period and the ultimate gain 
respectively. 

8.2.2 Autotuning 

Autotuning is tuning the PID controller in an automatic way. It goes through the following steps. 
Step 1 (process activation), activate the process using the relay feedback method as shown in 
Figure 8.3. Step 2 (modeling), estimate the ultimate period and the ultimate gain using (8.29) 
and (8.30) from the measured period, the measured peak value of the process output and the 
magnitude of the relay output. Step 3 (tuning), calculate the tuning parameters of the PID 
controller using the ZN tuning rule. Step 4 (downloading), download the tuning parameters to the 
PID controller. When the user sends a signal to the autotuner by pushing a start button, the 
autotuner performs the whole procedure from Step 1 to Step 4 automatically. So, the user who has 
no knowledge of process control can successfully tune a PID controller in a very simple way. 

Example 8.2 

Simulate Figure 8.3 with the process G{s) = exp(— 0.5s)/(s + l) 2 . 

Solution The MATLAB code to simulate Figure 8.3 is shown in Table 8.1. 

8.3 Describing Function Analysis 

Describing function analysis can be used to derive (8.29) and (8.30) (Astrom and 
Hagglund, 1984, 1995). A describing function is a transfer function of a nonlinear element 
for a given frequency. For example, consider the symbol representing the ideal relay on-off in 
Figure 8.4, where the x-axis and the y-axis represent the input of the relay and the output of the 
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Input 

d 


Output 




0 




-d 



Figure 8.4 Symbol of an ideal relay. 

relay respectively. So, if the input is greater than zero, then the relay output is d. Otherwise, the 
relay output is —d. Assume that the input is the sine signal of a sin(rnf), where a and oj are 
respectively the amplitude and the frequency of the sine signal. Then, the relay output will be 
the square signal in Figure 8.5 according to the relay symbol in Figure 8.4. 



Figure 8.5 Relay output for a sine input. 


The square signal of the relay output can be represented by a Fourier series and it can be 
approximated by a sine signal of the fundamental frequency as follows: 

Ad Ad Ad Ad 

u(t) = —sin(cot) H-sin(3mf) H-sin(5wt) + • • • « —sin(cu?) (8.31) 

n 3 k 5tt n 

where u(t), d and oj denote the relay output, the magnitude of the relay on-off and the relay 
frequency respectively. p r denotes the period of the relay. Then, when entering the a sin(ojt) 
signal into the nonlinear element (here, the relay) the output of the nonlinear element is Ad sin 
(ojt)/K. So, the amplitude ratio of the relay is Ad/na and the phase angle is zero. So, the transfer 
function (the describing function) of the relay is 

4 d 4 d 

N(a ) = — exp( - Oi) = — (8.32) 

na na 

Until now the describing function of the ideal relay has been derived. Again, it is emphasized 
that the describing function is just a transfer function of the nonlinear element for a given 
frequency. 

Now, consider the block diagram in Figure 8.6 for relay feedback control. Note that it 
produces the same oscillation as that in Figure 8.3 in the cyclic steady state because the input of 
the relay is a negative feedback of the process output (that is, — y(t)). Because the closed-loop 
system shows continuous cycling (marginally stable), the characteristic equation of Figure 8.6 
will satisfy the following condition: 


1 +N(a)G(iot)) = 0 


(8.33) 




So, the frequency information of the process for the relay frequency co = 2n/p r can be 
estimated from (8.33) as follows: 


GW 


1 

N(aj 


n a 
4 d 


(8.34) 


Here, it should be noted that the imaginary part of G(ico) is zero. So, the frequency oj = 2n/p r 
is the ultimate frequency of the process and the reciprocal of the absolute value of G(iu>) is the 
ultimate gain of the process. That is: 



Pr 


Pu ~Pt 


(8.35) 




4 d 
na 


(8.36) 


where cd u , p u and k u denote the ultimate frequency, the ultimate period and the ultimate gain 
respectively. These results are the same as (8.29) and (8.30). 


Example 8.3 

Obtain the describing function for the nonlinear element in Figure 8.7. This is composed of two 
channels (Friman and Waller, 1997). One is the proportional channel of the conventional relay 
and the other is the integral channel of the conventional relay combined with the integrator. 
Here, the magnitude of the relay is one. 



Solution Assume that the input of the two-channel relay is the sine signal of asin(wf)- 
Then, the output of the proportional channel is the square signal in Figure 8.5 according to 
the relay symbol in Figure 8.7. Then, the output of the proportional channel is approximately 
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K p A sin(tuf)/jr. So, the describing function of the proportional channel is the same as that of 
the ideal relay: 

N(a,K p ) = K p — (8.37) 


Consider the integral channel. The sine signal a sin(cuf) goes through the integrator. Then, it 
becomes —a cos (a)t)/<o = a sin(<nf — 7t/2)/oj. Then, the relay input of the integral channel is 
lagged by 7t/2 compared with the input sine signal. This means that the output of the integral 
channel is K,4 sin(cuf — jt/2)/tc approximately. So, the amplitude and the phase angle of the 
integral channel are Kfi/na and —jt/2 respectively. Equivalently, the describing function of the 
integral channel is 


N(a, Ki) = Ki — exp( - m/2) 

7t a 

Finally, the overall describing function of the two-channel relay is 
N(a, K p , K,) =* a [K P + Ki exp( - i*/2)^ ^ (K p - iK,) 

= — J K/ + K/exp [ — iarctanfA'i/A'p)] 


(8.38) 


(8.39) 


Example 8.4 

Obtain the frequency response of the process from the process input and output activated by the 
two-channel relay in Example 8.3. Here, the magnitude of the oscillation of the activated 
process output is a and the period of the oscillation is p T . That is, the process output is 
approximately a sin(wt). M = 2 n/p r . 

Solution Because the process output is in continuous cycling, the following equation is 
satisfied: 


l + N{a,K p ,K i )G{i(o) = 0 (8.40) 

Then, the frequency response of the process at the frequency cd is 

G(iw) = ~ , i , =- ^ exp[iarctan(A' i /A' p )] (8.41) 

"{a, A p ,Ai) aJk^ + K/ 

It should be noted that the real and the imaginary parts are both negative. So, the frequency 
region identified by (8.41) is a lower frequency region than the ultimate frequency, as shown in 
Figure 8.8. As a result, the two-channel relay feedback method can identify the frequency 
response data of the process in the third quadrant of the Nyquist plot by adjusting K p and K,. 

Example 8.5 

Obtain the describing function for the following nonlinear element. It is the ideal relay 
combined with the time delay (Kim, 1995; Tan et a!., 1996). Here, the magnitude of the relay 
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Figure 8.8 Identified Nyquist point by the ideal unbiased-relay feedback method and the two-channel 
relay feedback method. 

Solution Assume that the input of the relay combined with the time delay is the sine signal 
a sin(cot)- Then, the output of the nonlinear element in Figure 8.9 is approximately u(t) = 4 d sin 
(cot — ojO)/k because the square signal of the ideal relay is delayed as long as 9. Then, the 
amplitude ratio and the phase angle are 4 d/tta and — o)9 respectively. Equivalently, the 
describing function of the relay plus time delay is 

4 d 

N(a, 9) = —exp( — iw9) (8.42) 



Figure 8.9 Relay combined with time delay. 


Example 8.6 

Obtain the frequency response of the process from the process input and output activated by the 
relay plus time delay in Example 8.5. Here, the magnitude of the oscillation of the activated 
process output is a and the period of the oscillation is p T . That is, the process output is 
approximately a sin(wt), (o = 2itlp r . 

Solution Because the process output is in continuous cycling, the following equation is 
satisfied: 


l+N(a,9)G(i<o) = 0 


(8.43) 
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Then, the frequency response of the process at the frequency co is 

G(i “ ) = -iv^b) = -s exp( “’ 9) (8 - 44) 

The real and the imaginary parts are both negative. So, the frequency region identified 
by (8.44) is a lower frequency region that the ultimate frequency. 


8.4 Fourier Analysis 

The describing function analysis cannot provide exact frequency data of the process because it 
approximates a square signal to a sine signal. Fourier analysis can overcome this problem. It 
can estimate the frequency response data of the process without the modeling error from the 
process input and the process output activated by the relay (Sung and Lee, 1997). 


8.4.1 Fourier Analysis 

Assume that the process input (that is, relay output) u{t ) and the process output y(t) after t ss 
are periodic with the period of p r . Then, the frequency response of the process can be 
estimated by 


j/j +Pt y (t)exp(- i (ot) dt 

f ss+Pt M (f) eX p(_ d f 


(8.45) 


where oj should be zero or a multiple of co T = 2nlp r . That is, the frequency responses of the 
process for several frequencies (zero, a> r = 2 nlp r , 2<o„ 3 od x , .. .) can be estimated using (8.45) 
with numerical integration. 


8.4.2 Derivation of Fourier Analysis 

From the transfer function 


(8.46) is obtained: 


G(s) = 

Jo~ «(0«P( - st) d t 


G(i(o) 


f 0 °°y(t)exp(-iw?) dt 
w(f)exp( - i cut) dt 


Now, consider (8.47). 


| y(t)exp( - i (ot) dt = | y(t)exp( - i<wt) dt + | y(t)exp( - i<ut) dt 
+ | y(t)exp( - i cat) dt + 


(8-46) 


(8.47) 
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Note that exp(— iwt) = cos (wt) — i sin(rnf) is a periodic function of period p r because w is zero 
or the multiple of w r = 2nlp r . Also, u(t) and y( t) after t ss are also periodic functions of the same 
period. Then, y(t)vexp(— iwt) is also a periodic function of the period of p,. Then, (8.48) 
and (8.49) are derived: 


| j(O ex P( 

| o w(t)exp( 


i wt) At = I y(t)exp( - iwt) At + lim n v j y(t)exp( - iwt) At (8.48) 

iwt) At = | w(t)exp( — iwt) df+ lim n p | w(t)exp( — iwt) At (8.49) 


Also, note that | 0 “ >’(f)exp(— iwt) At and ( Q ss u(t)exp( — \wt) At are negligible compared 
with lim n p )(“ +Pr >’(t)exp(— \wt) dt and lim n p j^ +PT u(t')exp(— iwt) At. So, the Fourier 
analysis (8.50) can be derived from (8.46), (8.48), and (8.49): 

, Jo ss >'(0exp(-i«0dt+ J™ n p +Pr y(f) exp (—iwt) At j tss+p 'y(t)exp(-iwt)At 

G(io)) — — - . -— " s i - 

J 0 ss w(*)exp(-kt>r)df+ lim «p)J ^ r w(^)exp(-iw/)d^ jj Pt u(t)exp(-ia)t)dt 

(8.50) 


No approximations are used for the derivation of (8.50). So, the frequency data obtained 
using (8.45) are exact only if the signals of u(t ) and y(t) are periodic functions after t ss . Usually, 
the activated signals by the relay feedback become periodic functions after three or four 
relay on-offs. Then, all the frequency responses corresponding to the multiples of the relay 
frequency and zero frequency can be exactly identified by (8.45). For example, the three lots of 
frequency response data of the process for 0, w T and 2w r can be estimated by calculating (8.45) 
repetitively for 0, w r and 2w r only if the activated signals include the three frequency components. 


8.4.3 Application of Fourier Analysis 

Consider the process input and output in Figure 8.10 activated by a biased-relay feedback 
method. In biased-relay feedback, the reference value for the relay on-off is a bias of 0.5 rather 



Figure 8.10 Process activation by the biased-relay feedback method. 
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than zero (zero means the initial process output value). That is, the relay output is 1.0 if the 
process output is greater than the reference value (bias) of 0.5 and the relay output is — 1.0 if the 
process output is less than 0.5. For a more detailed description on relays, refer to Chapter 12. It 
is clear in Figure 8.10 that |) ,ss +Pr y (f)exp(— i wt) d t and J ( 4s +Pt w(f)exp(— iwt) d t for « = 0 are 
not zero. This means that the signals u(t) and y(t) include a significant amount of the zero 
frequency information, which becomes bigger as the bias increases. Also, the signals must 
include the frequency information corresponding to the relay frequency at,, (fundamental 
frequency). So, the frequency responses of the process for zero and co r can be estimated 
by (8.45) for the biased-relay test. 


8.4.4 Analysis of the Fourier Analysis 

Assume that the static input disturbance d m is added to the process input. Note that 
\'f +Pr c/ M1 exp(— i (o T t) dt = 0 for a> r = 2nlp r . Then, obtain 

|*4s +Pr |* 4s +Pr I* 4s +Pt 

(u(t) + c/in)exp(— icu r f) At = m(/) exp( — i<w r t) At + (/ in exp(—icu r f) di 

= w(t)exp( — ico r f) At (8.51) 


So, obtain the same estimate from the Fourier analysis as shown in (8.52) even in the presence 
of the input disturbance: 


= m 


j£ +Pl y(0exp(- icu r t) d t _ j£ +Pt y(t)exp(- At 


Jclr +P ' + 4n)exp(— i (o r t) df J^ s +Pt u(t)ex p(— i co T t) At 


(8.52) 


That is, the Fourier analysis of (8.45) provides the exact frequency response for the relay 
frequency oj,. under the circumstance of a static disturbance. Note that wrong deviation 
variables are equivalent to the case of static disturbances, meaning that the Fourier analysis 
provides an exact estimate even though wrong deviation variables are set. 

Consider (8.52) for the zero frequency of ca = 0: 


[tss+p, [t ss +P, fhs+P, [tss+Pr 

j (u(t) +c/in)exp(-i0t) At = u{t)At+ d m At = u(t) At + d m p r 

(8.53) 

If ff +Pr u{t) At d m Pv in (8.53), then the effect of the disturbance becomes negligible, like 

f 4s +Pr r4s +Pt 

j (u(t) + c/in)exp(— iOt) At w J tc(f)exp(— iOt) At 


From (8.53), it is clear that the modeling error for the zero frequency can be reduced 
by increasing the integral + Pr u(t ) At. For example, the modeling error can be reduced by 
setting a large reference value (bias) to the biased-relay because the integral term usually 
becomes bigger upon increasing the reference value. 
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In summary, the Fourier analysis of (8.45) for the relay feedback identification has the 
following advantages compared with the describing function analysis. First, the frequency 
data set obtained is exact. Second, it can obtain several additional frequency data sets 
corresponding to multiples of the relay frequency and the zero frequency. Third, it provides 
the exact frequency data set corresponding to the relay frequency for a static disturbance. 
Fourth, it provides the exact frequency data set corresponding to the relay frequency even 
for wrongly specified deviation variables and/or an initially unsteady state. On the other 
hand, Fourier analysis has the disadvantage that it requires the whole data of the one 
period for the numerical integration. If the sampling time is not small enough, then the 
numerical integration becomes inaccurate. Then, Fourier analysis may result in unacceptable 
estimates. 

Example 8.7 

Activate the process G(s ) = exp(— 0.2s)/(s + l) 2 using a biased-relay for which the reference 
value is 0.5 and estimate the frequency responses using Fourier analysis. 

Solution The MATLAB code for Example 8.7 is shown in Table 8.2. 


8.5 Modified Fourier Transform 

Fourier analysis uses only the cyclic-steady-state data points to estimate the frequency 
response data. So, it can provide only several frequency response data because the cyclic- 
steady-state data usually include a few frequency components. The modified Fourier 
transform is a frequency response estimator to estimate all the desired frequency data of 
the process (Sung and Lee, 2000). It uses all the process data from the initial transient region 
to the cyclic-steady-state region. The initial transient region usually includes very many 
frequency components. So, it is possible to estimate all the desired frequency responses of the 
process. 

Consider the two different types of process activation in Figure 8.11 of which the initial parts 
are in zero steady state. Figure 8.11 is the process input and output activated by a biased-relay 
for which the final part is in a cyclic steady state. Figure 8.12 shows the process activation using 
a proportional controller for which the final part is in steady state. 

The following two modified Fourier transforms can estimate the frequency responses of the 
process for the two cases in Figures 8.11 and 8.12. 


Modified Fourier Transform for the Cyclic Steady State Assume that the process input (that 
is, the relay output) u(t ) and the process output y(t) after t ss are periodic with period p T and u(t) 
and y(t) are initially in the zero steady state. Figure 8.11 is one of the examples. Then, the 
frequency responses of the process can be estimated by 


G(i<u) = 


[1 - exp(- iw/> r )] Jq ss exp(— i an)y(x) dr + j t ‘ ss+Pt exp(- iwr)y(r) dr 
[1 — exp(— iw^r)] Jo SS exp(— i wt)m(t) dr + +Pr exp(— i wz)u(z) dr 


(8.54) 
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Modified Fourier Transform for the Steady State Assume that the process input u(t) and the 
process output y{t) after t ss are in a steady state and u(t) and y(t) are initially in a zero steady 
state. Then, the frequency responses of the process can be estimated by 


G(itu) = 


(itu)exp(iwt ss ) J Q SS exp( — iwT)y(r) dr + y(t ss ) 
(iw)exp(icut ss ) J Q SS exp( — i(oz)u(z) dr + u(t ss 


(8.55) 


In (8.54) and (8.55), w can be any value. So, the frequency responses of the process for all the 
desired frequencies can be estimated by (8.54) or (8.55) with numerical integration. 

8.5.1 Derivation of the Modified Fourier Transform 

The objective of the modified Fourier transform is to estimate G(icu) for the following general 
linear time-invariant process (8.56) from the process input of u(t ) and the process output of y(t): 


G(s ) = ZM = b m st n + b m -is m 
u(s) a„s" + a„- 1 s"- 


• +bis + bo 
■ + a\s + 1 


Equation (8.56) is equivalent to (8.57) with an initially zero steady state: 
„ d n y(t) d n ~ 1 y(t) dy(t) 


' ->•(/) 


= bm ‘tyiH +bm d" 1 " ‘kQ) 

m d t m dr - 1 


(8.56) 


(8.57) 


Consider the transform 

y k (s, t) = | exp( - sz) dr, k= 1,2,... and y 0 (s, t) = J exp( - sz)y(z) d z 

(8.58) 

The transform satisfies the property (8.59), derived by integration by parts: 
y»( s ’ 0 = j o ex P( - ST ) dt = *y»-i (*, t) + ex P ( - st ) A At „ y }^ 


2 / x , , d n 2 y{t) d" x y{t) 

= s 2 y n - 2 (s, t) + sex p( - st) d? „_ 2 +exp( - st) - 


d r~ 


= s n y 0 (s, t) + exp( - st) 2 + / 


(8.59) 


3 d 2 y(t) | | d ” V(f) \ 

d t 2 dt"- 1 ) 

+ y _1 exp (-st)y(t) 

= s n y 0 (s, t) + exp( - st)D y (n - 2, s, t) + sf~ r exp( - st)y(t) 

where D y [n — 2, s, t) = ^~ 2 dy(t)/dt + s"~ 3 d 2 y(f)/df 2 + ••• 4-d" _1 ;y(*)/d<" _ 1 . If apply the 
transform to (8.57), obtain 

(a n f + a„- 1 / 2-1 + • • • +a\s+ l)yo(j, t) + exp(— st) (a„D y (n — 2, s, t)+a „-1 D y (n — 3,5, t) 
+ ••• + a 2 D y (0, s, t)) + exp(- st)(a„s”~ 1 + a n - !s"~ 2 + ■■■ +ai)y(t) 
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= {b m f + b m -xf 1 1 + • • • + bxs + b 0 )uo(s, t) + exp(- st)(b m D u (m - 2, s, t) 

-+/>„, xD u (m — 3,s, ?)+••• +b 2 D u (0, s, t)) 

+ exp( - si){b m r~ l + b m . + bx)u(t) (8.60) 

From now, let us consider the two cases. The first case is that the process input u(t ) and 
the process output y{t) after t ss are periodic with period p r . The second case is that the process 
input u(t ) and the process output y(t) after t ss are in a steady state. 


8.5.1.1 Case 1: Cyclic Steady State 

Note that d* - l y(t)/dt k ~ 1 \ tm+Pt and d k ~ l y{t)/dt k ~ 1 | 4s are the same because y(t) after ? ss is a 
periodic function for which the period is p r . It is also valid for u(t). So, (8.61) and (8.62) are 
obtained 


P 'dVr) , 

~dx k 


P, d 'm(t) 


d^-yO l 

\ dt k 1 | s . 

d/ A 1 | 4s . 


<* k yo i 

At k 1 | 4s 

d k ~ l u{t) \ 
d t k ~ 1 


= 0, k= 1,2,... 

(8.61) 

= 0, k= 1,2,... 

(8.62) 


And (8.63) is obtained by integrating (8.57) from t ss to t ss + p, and using (8.61)—(8.62): 


y(r) dr = b 0 


u(t) dr 


(8.63) 


Now, let us integrate (8.60) from f ss to t ss + p t after multiplying expt.s/) and use (8.61)-(8.63) 
to simplify the results. Then, (8.64) is obtained 


b m r +...+bp_s +p,: ,vo(.c Qexp(,y?) dt + +A y(Q d t 

a„s" -1 5 j£ +p < u 0 (s, t)exp(st) dt + j£ +Pt u(t) dt 


(8.64) 


In (8.64), the term of j/ ss +/,r >'o(‘S , ? t)exp(st) dt can be simplified by integration by parts as 
follows: 


f'ss+A tt pss+fr j*4s + Pi 

sj f)exp(jt) dt = exp(st) J exp( - jr)y(r) dr -J y(r) dr 

= exp(5t ss ) |^(exp(,sp r ) - 1) | exp( - sr)y(r) dr + exp(s/? r ) 
x | exp( - .tr)y(r') drj - J y(r) dr (8.65) 

Then, (8.64) becomes 

[1 - exp( - .vp r )] J 0 ' ss exp( - .vt) v(t) dr + +Pl exp( - jt).v(t) dr 
[1 — exp( — s /7 r )] J 0 4s exp( — jt)m(t) dr + f t “ +p ‘ exp( — sx)u(t) dr 


( 8 . 66 ) 
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By substituting icu for s, the modified Fourier transform for the cyclic steady state (8.54) is 
obtained. 


8.5.1.2 Case 2: Steady State 

Note that A k y{t)/dt k \ hs = 0 and d k u{t)/dt\ s = (),k=\, 2. 
are in a steady state. So, (8.57) at t=t ss becomes 

y(t ss ) = b 0 u(t ss ) 

Then, (8.68) is obtained from (8.60) at t=t ss : 

_ sexp{st ss ) J 0 ' ss exp( - 5r)y(r) dr + y(t s 


G(s) = 


because y(t ) and u(t) after t ss 

(8.67) 

( 8 . 68 ) 


5exp(jf ss ) J 0 4s exp( - sz)u(x) dr + u(t ss ) 

By substituting icu for s, the modified Fourier transform for the steady state of (8.55) is obtained. 

8.5.2 Analysis of the Modified Fourier Transform 

Assume that the static input disturbance d in is added to the process input. Note that 
j4s +p t ^ ineX p( _ i WrT ) dr = 0 for u> r = 2n/p r . Then, obtain 


exp( — i <o T z) (u(z) + di „) df = 


■c 


exp( — icu r T) i/(t) dr + 


exp( — i(t) t z)u(z) dr 


exp( — i(o T x)din dr 


(8.69) 


Also, note that 1 — exp(—icu r p r ) = 0 for (o r = 2n/p r . So, the same estimate from the modified 
Fourier transform for the cyclic steady state is obtained as shown in (8.70) even in the presence 
of the input disturbance: 

G( . jw _ [1 - exp( -ka r p r )] J 0 4s exp( - ift> r T)y(i) dr + J^ +j,r exp( - ico t z)y (t) dr 

[1 — exp( — i (>) r p t )\ J 0 4s exp( — icu r r) (m(t) + d^) dr + f ss +Pt exp( — iw r r) (m(t) + dm) dr 
[1 - exp( -\oppf Jp ss exp( - i <o r z)yf) dr + f* +Pt exp( - ku r r )y(r) dr 
[1 — exp( — \(o T p r )\ J 0 4s exp( — ico r i)w(T) dr + J ? ' ss+ft exp( — iw r r )u(f) dr 

(8.70) 

That is, the modified Fourier transform (8.70) provides the exact frequency response for the 
relay frequency cu r under the circumstance of a static disturbance. Note that wrong deviation 
variables are equivalent to the case of static disturbances, meaning that the modified Fourier 
transform provides the exact estimate even though wrong deviation variables are set. 
Consider (8.71) for the zero frequency of to = 0. Also, note that 1 — exp(— i(op T ) = 0 for oj = 0. 

r4s+A- |*4s +Pr r4s+Pr f4s+/4 

| exp( — i0T)(w(i) + dm) dr = u(x)dt+ dm dr = u{x) dr + di n p T 

(8.71) 
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From (8.71), it is clear that the modeling error for the zero frequency can be reduced by 
increasing the integrals |' ,ss +Pr u(%) dr and Jjj" u(t) dr. For example, the modeling error can be 
reduced by setting a large reference value (bias) to the biased-relay. The same conclusion can be 
obtained for the modified Fourier transform for the steady state. 

In summary, the modified Fourier transform of (8.54) has several remarkable advantages. First, 
the modified Fourier transform for the cyclic steady state can provide the exact frequency response 
data for all the desired frequencies if the final parts of the process input and process output are in a 
cyclic steady state and the initial parts are in a zero steady state. Second, the modified Fourier 
transform for the steady state can provide the exact frequency response data for all the desired 
frequencies if the final parts of the process input and process output are in a steady state and the initial 
parts are in a zero steady state. Third, the modified Fourier transform for the cyclic steady state 
provides a better accuracy for the disturbance compared with the describing function analysis. 
Fourth, the modified Fourier transform for the cyclic steady state provides the exact frequency 
response data for the frequency of the relay even though wrong deviation variables are assigned. 

Example 8.8 

Activate the third-order plus time-delay process (8.72) using the biased-relay feedback method 
for the two cases of no measurement noise and measurement noise. The process output for the 
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Figure 8.13 Process input and output data activated by the biased-relay feedback method in Example 
8.8: (a) no measurement noise; (b) measurement noise. 
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measurement noise case is contaminated by random measurement noise distributed uniformly 
between —0.05 and 0.05. Also, estimate the frequency responses of the process from the 
activated process data using the modified Fourier transform for the cyclic steady state. 


G(.) = 


exp( — 0.1 j) 

'?§8p^ 


(8.72) 


Solution The process input and output data activated by the biased-relay feedback method is 
shown in Figure 8.13. The frequency response data obtained by the modified Fourier 
transform (8.54) are exact, as shown in Figure 8.14a. Also, the modified Fourier transform 
shows acceptable robustness to measurement noise, as shown in Figure 8.14b. Tables 8.3 
and 8.4 show the MATLAB codes for the cases of no measurement noise and measurement 
noise respectively. 




(b) 

Figure 8.14 Identification results by the modified Fourier transform for the cyclic steady state in 
Example 8.8: (a) no measurement noise; (b) measurement noise. 
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Table 8.3 MATLAB code for the modified Fourier transform for the cyclic steady state in Example 8.8 with 
no measurement noise. 


fourier_MFTl.m 

g_fourier_MFTl.m 

clear; 

function 

delt=0.005;‘1S£t=25? ji=round|S®/delt) ; 

[next_x, y] =g_f^ihf ier_MFTl (x, delfij#.) 

u_data=zeros(1,500); x=zeros(3,1); 

subdelt=delt/10; 

t_on=0.0; t._of :-C.C; ?_or.-0; 

rij=round (delt/subdelt) ; 

?_o f f^O"; 

A= [ 0 0 -1 ; 1 0 -3.0 ; 0 1 -3.0 ] ; 

y=0.0; yref=Q.3; np=0; 

B= [ 1 ; 0; 0 0 !] > delay=SJ : vt* 

index=0; y_delta=0.1; 

delay_k=round-(delay/delt+0.00001) ; 

^^knitial phase : index=0, relay 

for i=l: n 

phase:index=l 

dx=A*x+B*u (500-delay_k); 


x=x+dx*subdels| : |: : ', 

for i=l: n 

end 

t=i*delt; yy(:) -y; yyref(i)=yref; 

next_x=x; yo=C*x; y=yo; 

■ttmht; 

ret®**/ 

if(index—1) 


.iff (yy (i) >yref & yy ( L- 


1)<=yref) 

command window 

P_on=t-t_on; t_off=>,f,-- 


np=np+l; 

» f ourier_MFTl| 

:f8t>.np==3 tss_array=i; end 


'jkg,-np-~4 tss_pr_array=i; 


end 


end 


if(yy(i)<=yref & yy(i- 


1)>yref) 


P_dft_on=t; 


end 


end 


if(y>yref) u=-1.0; end 


if(y<=yref) u=1.0; end 


if(index==0) 


u=1.0; if(y>y_delta) index=l; 


end 


end 


for j=l:499 


u_data(j)=u_data(j+1); end 


u_data(500)=u; uu (i)-u; 


P=P_on+P u _Q'f f; 


[x,y] =g_fourier_MFTl (x,de ;.t:,i;_da t.a) ; 


end 


for k=l: 30 


w(k)=(2*pi/P)*(k-1)/20; 


j=complex(0,1); 


s=j*w(k); sl=complex(0,0); 


s2=complex(0,0); 


s3=complex(0,0); s4=complex(0,0); 
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Table 8.3 ( Continued) 

_ Jfo'h i=l: tss_array-l 
sl=sl+exp(- 
s*tt(i))*yy(i)*delt; 

s3=s3+exp(- 
s*tt(i))*uu(i)*delt; 

i-=tss_array: tss_pr_a».gay-l 
s2=s2+exp(- 
s* fit( 1 ))*yy(i)*delt; 

s4=s4+exp(- 
s*tt(i))*uu(i)*delt; 

num_m=(l-exp(-s*P))*sl-s2; 
den_m=(1-exp(-s*P))*s3+s4; 
gj w_m=num_m/den_m; 

Re_m(k)=real(gjw_m); 

Im_m(k)=imag(gjw_m); 
gjw=exp(-0.l*s)/(s+1) A 3; 

Re (k) =real (gjw) .jrim (k) =imag (gjw); 
end 

figure (1) ; 

plot(tt,yyref,tt,uu,tt,yy); 
figure (2) ; plot (Re, Im, ' - 
' , Re_m, Im_m, 


Table 8.4 MATLAB code for modified Fourier transform for the steady state in Example 8.8 with 
measurement noise. 


foukier_MFT3.m 

clear; 

delt=0 . CCb; ;tiS-3C; «=round,|;tt/delt) 
u_data=zeros (1,500) ; x=zeros (3,1) ; '■ 
t_on=0.0; t_off=0.0; ?_or~0; 

?_o:f-Q; 

y=0.0; yref=0.3; np=0; 
index=0; y_delta«0.3; %i^|i ; Sf:al 
phase : index=0, relay phase : index=l 
hys=0.05; index_up=l; index_down=0; 
rand( ' seed',0); noise=(rand(1,n)- 
0,5)*0.1; 
for i=l:n 

t?=i*delt; yy (i) =y+no±se (±) ;>> 
yyref (i) =yre|f it (i) =t; 
if(index==l) 

if(index_down==l & 
index_up==0 & yy(i)<=(yref-hys) & 
yy(i-1)>(yref-hys)) 


g_fourier_MFT3.m 
fua#M:Sli> 

[next_X,y]=g_fourier_MFT3(x,delt, 

subdelt=delt/l;i3i 

n=round(delt/subdelt); 

A-10 0 -1 Vi 0-3.0 ; 0 1 -3.0]; 

B= [ 1 ;■ M 0 ] ; C= [ 0 0 1 ] ; delay=0.1 ; 
delay_k=round (delay/delt+0.00001) 
for i=l: a 

dx=A*x+B*u(500-delay_k); 
x=x+dx*subdelt; 

next_x=x; yo=C*x; y=yo; 


command window 
» fourier_MFT3 


(continued) 
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Table 8.4 ( Continued) 
gj w_m=num_m/den_m; 

Re_m(k)=real(gjw_m); 

Im_m(k)=imag(gjw_m); 
gjw=exp (-O'. l*s) / (s+1) A 3; 

Re(k)=real(gjw); Im(k)-imag(gjw); 
end 

figure (1) ; 

plot(tt,yyref,tt,uu,tt,yy); 
figure (2) ; plot (Re, Im, ' - 
' , Re_m, Im_m, 



Figure 8.15 Process input and output data activated by the proportional controller in Example 8.9. 


Example 8.9 

Activate the third-order plus time-delay process (8.72) using a proportional controller. Also, 
estimate the frequency responses of the process from the activated process data using the 
modified Fourier transform for the steady state. 

Solution The process input and output data activated by the proportional controller are shown 
in Figure 8.15. The frequency response data obtained by the modified Fourier transform (8.55) 
are exact, as shown in Figure 8.16. Table 8.5 shows the MATLAB codes. 

8.6 Frequency Response Analysis with Integrals 1 

Lee et al. (2007) proposed new process identification methods which use the integrals of the 
relay response instead of point data. This guarantees better accuracy and advantages in obtaining 
the ultimate information of the process compared with the describing function analysis 


1 Integrals of Relay Feedback Responses for Extracting Process Information, Lee et al. AIChE J. Vol. 53 Copyright 
©[2007] John Wiley & Sons, Inc. 










Process Identification Methods for Frequency Response Models 


263 


Table 8.5 ( Continued) 
s*tt(i))*yy(i)*delt; 

s3=s3+exp (- 
s*tt(i))*uu(i)*delt; 

num_m=s*exp(s*tt(n))*sl+yy(n); 
den_m=s*exp(s*tt(n))*s3+uu(n) ; 
gjw_m=num_m/den_m; 

Re_m(k)=real(gjw_m); 

Im_m(k)=imag(gjw_m); 
gjw=exp(-0.l*s)/(s+1) A 3; 

Re (k) =real (gjw) .J'jn(k) =irftag (gjw) ; 
end 

figure (1) ; 

plot(tt,yyref,tt,uu,tt,yy); 
figure (2) ; plot (Re, Im, ' - 
' , Re_m, Im_m, 


approaches because the effects of high-harmonic terms are suppressed significantly by using the 
integrals of the relay responses. Because it is not required to store the process input and output 
and the computations are simple, it can be incorporated easily in commercial PID controllers. 

8.6.1 Estimation of Ultimate Frequency Response Data 

Consider the conventional relay feedback system shown in Figures 8.17 and 8.18 to derive the 
frequency response analysis method with integrals. The relay feedback system starts at a steady- 
state condition. The relay is first kept on until the process output rises to a given level and then is 
set to the normal mode of switching at the instant that the process output crosses a given set point. 
This relay feedback system will produce a stable oscillation, as shown in Figure 8.18. It is notable 
that the given level in the beginning of the relay feedback should be set to a significantly large 
value if one want to extract the zero-frequency information of the process. Otherwise, it cannot 
guarantee acceptable robustness in extracting the zero-frequency information from the relay 
responses. 



Figure 8.17 A conventional relay feedback system and the integrals of the responses. Integrals of Relay 
Feedback Responses for Extracting Process Information, Lee et at. AIChE J. Vol. 53 Copyright ©[2007] 
lohn Wiley & Sons, Inc. 
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Figure 8.18 Typical relay responses and their integrals. Integrals of Relay Feedback Responses for 
Extracting Process Information, Lee et al. AIChE J. Vol. 53 Copyright ©[2007] John Wiley & Sons, Inc. 

Let us review briefly the describing function analysis and introduce the frequency response 
analysis with integrals. The describing function analysis uses the oscillation data to extract 
approximately the ultimate frequency response of the process. Let the input and output 
trajectories be u{t) and y(t) for the conventional relay feedback system respectively. At time t ss , 
u(t ) andy(f) are assumed to be fully developed (cyclic steady state). This can be represented by 
the Fourier series as follows: 

u(t) = ^ |sin(wt) + ^sin(3wt) + ^sin(5<wt) + • • - j (8.73) 

where t = t — t ss and d is the relay magnitude. Let p r and cd = 2%lp r be the period and the 
frequency of the oscillation respectively. The output corresponding to u(t) is 

,y(7) = ^ [|G(iw)|sin(wf+ ZG(i®)) + ^|G(i3w)|sin(3«t+ ZG(i3w)) + • • •] (8.74) 

where G(s) is the transfer function of the process. Neglecting the high-harmonic terms and 
assuming /G(ico)tz—n, the ultimate frequency w u = 2n/p r , and lift) « 4c/sin(w u 7)/7r, 
y(t) w 4r/|G(im u )|sin(m u 7+ /G(ico u ))/n « — 4t/|G(im u )|sin(<w u 7 )/n are obtained. So, the 
amplitude of y(t) is 4c/IGtim u )l/7r. Then, the following approximate ultimate period of p u and 
ultimate gain of k cu are obtained as 

Pu = Pr (8.75) 


kcu 


1 _4 d 

|G(iw u )| _ na 


(8.76) 
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where a is the measured amplitude of y{t). It should be noted that the estimated ultimate data are 
approximates because the high-harmonic terms are neglected. As a result, the ultimate 
period (8.75) and the ultimate gain (8.76) show relative errors up to 5% and 18% respectively 
for the FOPTD process. In this case, the ultimate gain error may not be acceptable. 

The frequency response analysis method using integrals uses the integrals of the process 
input and output instead of the point data to obtain more accurate frequency responses of the 
process by suppressing the effects of the high-harmonic terms. 


8.6.2 Frequency Response Estimator 1 

Let u,(t) and ydt) be the integrals of the relay responses as 


(0 = [ w(t) dr 

Jo 

(8.77) 

MO = [ y(*) dT 

Jo 

(8.78) 


From (8.73), the response udf) after f ss is 


UiQ) = u im - ^ Jcos(wi) + ^cos(3w?) + ^cos(5wt) + • • •] (8.79) 

where u im is the mean value of U\(t) as follows: 



From (8.74), the response y x (t) after f ss can be represented as 
4d l _ 1 

ym) = yim-|G(W) |cos(<wf + ZG(ico)) + - |G(i3w) |cos(3wt + ZG(i3co)) + 

nco l 9 


where y im is the mean value of y\(t)\ 

\ rhs+P, 

yim= JAt 

Figure 8.18 shows the typical plots of these responses. 

Then, yfi) « y im + 4J|G(iw u )|cos(w u t)/(7tw u ) for Ui(i) « u im — 4Jcos(w u 7)/ (Jt<n u ) is 
obtained by neglecting the high-harmonic terms and assuming ZG(iw) = — n (equivalently, 
the relay period is the ultimate period). So, the amplitude of yi(?) — yj m is 4dlG(ico u )\/(nco a ). 
Then, the following ultimate gain: is obtained 

1 ... 2dp r 

cu |G(i<Uu)| n 2 b 


(8.81) 

(8.82) 


(8.83) 
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Figure 8.19 Normalized wave forms of the fully developed relay feedback responses. Integrals of Relay 
Feedback Responses for Extracting Process Information, Lee et at. AIChE J. Vol. 53 Copyright ©[2007] 
John Wiley & Sons, Inc. 


where b is the amplitude of yi (7) — >’; m . The frequency response estimator (8.83) will be 
superior to (8.76) because the ratios of the high-harmonic terms to the fundamental frequency 
term in (7) are much smaller than those in y(i), as shown in (8.73), (8.74), (8.79), and (8.81). 

8.6.3 Frequency Response Estimator 2 

From the relay feedback responses, the following signals of u c (7) and y c (7) can be constructed 
by combining the signals of m(7), u\[~t), and y(7), y;(7): 

Me(7) = »(:7> + y [Mi(7 +/>r/4) - Mjm] = ^ sin(«7) + ^ sin(5m7) + • • • (8.84) 

yc{t) = y(i ) + y \y t (i +Pr/ 4) - Vim] (8.85) 

Remark that u(t) is a rectangular wave, Wj(7) is a triangular wave and u c (7) is their 
combination such that the third-harmonic term vanishes. The forcing functions of Mi (7) and 
m c (7) are closer to a sinusoidal wave than u (7) . Hence, y\ (7) and >> c (7) are closer to the sinusoidal 
wave than y(J) is. Figure 8.19 shows the typical plots of these responses. 

Approximating the maximum of y c (7) to 


max(y(7)) + ^max(y ( (7) -y im ) 


6nb 

Pr 



( 8 . 86 ) 
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8.6.4 Frequency Response Estimator 3 

Consider the following quantity: 


2 r- 

,s jX. 


y(T) 2 dT = ^-f|G(W 


b-|G(i;W)| 2 - 


(8.87) 


The right-hand side in (8.87) is derived by applying the orthogonality of sine and cosine 
functions to (8.74). It is remarked that, to compute the above quantity, the trajectory of y(t ) does 
not need to be stored. By ignoring the high-harmonic terms in q, (8.88) is obtained 


/c cu = 


Ad 

” |G(ica u )| ~ Tly/q 

If y(t) is sinusoidal, then a = fq and (8.76) and (8.88) provide the same results. 


( 8 . 88 ) 


8.6.5 Frequency Response Estimator 4 

Consider the following quantity: 

ft = pS‘ +Pt y^) 2 dT - 2y 2 m = (jG(ku)l 2 + 1 |G(i3ru)| 2 + • • •) (8.89) 


The right-hand side in (8.89) is derived by applying the orthogonality of sine and cosine 
functions to (8.81). By ignoring the high-harmonic terms in q h (8.90) is obtained 


1 2dp r 

| GWfi^ 


(8.90) 


If yi(t) is sinusoidal, then b = fq[ and (8.83) and (8.90) provide the same results. 

Figure 8.20 shows the relative errors in the estimated ultimate period and ultimate gains. For 
the FOPTD process with the ratios of the time delay to the time constant between 0.1 and 
5, (8.83), (8.86), (8.88), and (8.90) have relative errors below about 6%. This confirms that the 
relative errors of (8.76) for the ultimate gain can be improved considerably by the frequency 
response estimators using the integrals. 


8.6.6 Frequency Response Estimator 5 for Nyquist Point Data 

Until now the ultimate gain is estimated on the assumption that the period of relay feedback 
oscillation is the ultimate period. Strictly speaking, this is a wrong assumption. So, let us find 
the following amplitude ratio and the phase lag of the process at the frequency of the relay 
oscillation without the assumption: 

G(i«j) = A w exp[i(+ a> = 2n/p I (8.91) 

where 4 (u = lG(iw)l) and 4> w = n + LG( icu). From (8.76), (8.83), (8.86), (8.88), and (8.90), 
the approximate amplitude ratio at the frequency oj = 2n/p r can be obtained by neglecting 
high-harmonic terms. Among them, consider (8.90). 
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Figure 8.20 Relative error in the estimation of the ultimate period and gain for FOPTD processes 
G(s) = exp(— 8s)/(js + 1). Integrals of Relay Feedback Responses for Extracting Process Information, 
Lee et al. AIChE J. Vol. 53 Copyright ©[2007] John Wiley & Sons, Inc. 


Aa, 


2dp r 


(8.92) 


Equation (8.92) is the most accurate equation for the amplitude ratio at the frequency to = 2tt !p r . 
If \G(\na>)\ < IG(iw)l, n = 2, 3 , ..., its approximation error is 

\(A W - |G(uu)|)/|G(im)|| < ^/l + 1 / 3 4 + 1 / 5 4 +- 1 = - 1 = 0.0073 (8.93) 

Now, consider the following quantity: 


9 [tss+P, 

M(r)yi(T) dr 


Ui(z)yi(T) dr - 2u im y im 


^ H G « + !w!r s(ZG(i3 “ ,))+ ■ ■• ] 


2k ( sin^) G(i3w) 

sin(/G(i3<u)) 

sin(<() ft) )cos(/G(i3w))’ 

Pi Icos(0J + |G(ka)| . 

27cos(<(>J + 

81cos 2 (<£ m ) 



(8.94) 


Ignoring the high-harmonic terms, (8.95) is obtained 


(8.95) 
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Then, the approximate phase angle of the process is /G(ia>) w <fxo — n. As a result, the 
frequency response of the process can be estimated at the frequency of the oscillation by 
using (8.92) and (8.95). 

In summary, the frequency response estimators using the integrals of the relay responses can 
provide more accurate estimates for the frequency response data by reducing the high- 
harmonic terms. For FOPTD processes, the relative errors over 15% of the previous describing 
function analysis approaches in estimating the ultimate gain can be reduced to below 5%. They 
are very simple and can be applied easily to commercial PID controllers. 

Example 8.10 

Activate the process G(s ) = exp(— 0.2s)/(s + l) 2 and estimate the ultimate gain using 
(8.76), (8.83), (8.86), (8.88), and (8.90). Also, estimate the frequency response using (8.92) 
and (8.95). 

Solution The MATLAB code for the simulation and the estimated frequency responses are 
given in Table 8.6. 


Table 8.6 MATLAB code to estimate the ultimate gain and the frequency response using the integrals of 
the relay feedback signals in Example 8.10. 

frequency_integralsl .m 

delt=0.005; tf=20; n=round(tf/delt) ; 
u_data=zeros(1,500) ; x=zeros(2,1); 
t_on=0.0; t_off=0.0; P_on=0; P_off=0; 
u=0.0; y=0.0; yrefHO.O; np=0; 

Mi?=0.0; yi=0.0; y2 L~C . 0; % integijaSis of u, y and y A 2 from 0 

uii=0.0; yii=0.0; yi2i=0.0; % integrals of ui, yi and yi A 2 from tss 


to tss+pr 

uylis-O.O; 0; % integrals §jiu*yi and ui x y: Tjpli tss to tss+pr 

d=1.0; %magnitudej|J|relay 

ymin=10 A 10; ymax=-10 A 10; yimin=10 A 10; yimax=-10 A l(t^ 

index=0; y_delta=0.1; % initial phase : index=0, relay phase : index=l 

for i- : : r. 

t“i*delt; yy(i)=y; yyref (i) =yref; fefc;.(i) =t; 

yi=yi+y*delt; 

if(index==l) 

if(yy(i)>yref & yy(i-1)<=yref) 

P_on=t-t_on; t_off=t; np=np+l; 
end 

*$jf;(yy(i)<=yref & yy(^*|s)>yref) 

P_of f=t-t_of it. t_o&^; end 

end 

if (np==4) 

i^^K'(ymin>y) ymin=y; end 
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Problems 

8.1 Represent the periodic signals of Figure P8.1a, b and c using a Fourier series up to five 
terms. 

8.2 Assume that you obtain the process output y(t) = — a sin(cuf), co = 2n/p, a > 0 for the 
process input in Figure 8.1a. Find the frequency response of the process for the frequency 
co = 2n/p. 

8.3 Assume that you obtain the process output y(t) = b — a sin(u>f)> 0J = 2k/ p, a > 0 for the 
process input in Figure P8.1b. Find the frequency responses of the process for the 
frequencies co = 0 and oj = 2n!p. 



Figure 8P.1. 
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8.4 Assume that you obtain the process output y(t) = b + a\km(ojt — 4)/)+ ci2S\n(2w{ — <t> 2 ), 
(o = 2k/ p, </>, >0, (f> 2 > 0 for the process input in Figure P8.1c. Find the frequency 
responses for the frequencies oj = 0, oj = 2nIp and to = 4jt Ip. 

8.5 Simulate the conventional relay feedback control system for the process G(s) = exp 
(—O.l^VC^ + l) 3 and estimate the ultimate frequency response of the process from the 
activated process input and output. Also, compare the estimates with the actual ultimate 
frequency response. 

8.6 Simulate the relay feedback control system combined with the time delay (6 = 0.3) in 
Figure 8.9 for the process G(,s) = exp(— 0.1s)/(s + l) 3 and estimate the frequency 
response from the activated process input and output. Also, compare the estimates with 
the actual values. 

8.7 Simulate the two-channel relay feedback control system in Figure 8.7 for the process 
G(i , ) = exp(—0.1 ■?)/(.? + l) 3 and estimate the frequency responses from the activated 
process inputs and outputs. Also, compare the estimates with the actual values. 

(a) *T p = 1.0, Ki = 1.0 

(b) £p=1.0,/sT; = 0.0 

(c) ^p = 0.0,^=1.0. 

8.8 Simulate the biased-relay feedback control system for the process G(s) = 1 /(s + l) 4 and 
estimate the two frequency responses w = 0 and co = co r from the activated process input 
and output using Fourier analysis. w r is the frequency of the relay. Also, compare them 
with the actual values. 

8.9 Simulate the biased-relay feedback control system for the process G(s) = 1/(2 s + 1) 
(s + l) 3 and estimate all the frequency responses for oj = /cw r /10, k = 0,1,2,..., 15, from 
the activated process input and output using the modified Fourier transform. Also, 
compare them with the actual values. 

8.10 Simulate the proportional (P) control system of which the proportional gain is 1.0 for 
the process G(s) = 1/(2.? + 1 )(s + l) 3 and estimate all the frequency responses for 
(D = kwJ 10, k = 0, 1, 2,..., 15, from the activated process input and output using the 
modified Fourier transform. Also, compare them with the actual values. 

8.11 Run the virtual process of Process 3 (refer to the Appendix for details) and activate the 
process using a biased-relay. Estimate the two frequency responses for w = 0 and oj = oj r 
from the activated process input and the output using Fourier analysis. oj r is the frequency 
of the relay. 

8.12 Estimate all the frequency responses for (o = k(o I /10, k = 0,1,2,..., 15, from the activated 
data in Problem 8.11 using the modified Fourier transform. 

8.13 Obtain the tuning parameters of a PID controller using the IMC tuning rule on the basis of 
the identified frequency responses in Problem 8.11. Also, show the control performance 
of the PID controller for the virtual process. 

8.14 Obtain the tuning parameters of a PID controller using the ITAE-2 tuning rule on the basis 
of the identified frequency responses in Problem 8.12. Also, show the control perfor¬ 
mances of the PID controller for the virtual process. 

8.15 Simulate the conventional relay feedback control system for the process G(s) = exp 
(—0.3^)/(5 + 1 )(5,y + 1) and estimate the ultimate gains using (8.76), (8.83), (8.86), 
(8.88), and (8.90) and compare them with the actual value. 
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8.16 Estimate the frequency response of the relay frequency using (8.92) and (8.95) from the 
activated process input and output of Problem 8.15. 

8.17 Run the virtual process of Process 1 (refer to the Appendix for details) and activate the 
process using a conventional relay. Estimate the ultimate gains using (8.76), (8.83), (8.86), 
(8.88), and (8.90). 

8.18 Estimate the frequency response of the relay frequency using (8.92) and (8.95) from 
the activated process input and output of Problem 8.17. 

References 

Astrom, K J. and Hagglund, T. (1984) Automatic tuning of simple regulators with specifications on phase and amplitude 
margins. Automatica, 20, 645. 

Astrom, K.J. and Hagglund, T. (1995) PID Controllers , Instrument Society of America, NC. 

Friman, M. and Waller, K.V. (1997) A Two-Channel Relay for Autotuning. Industrial & Engineering Chemistry 
Research , 36 , 2662. 

Kim, Y.H. (1995) PI controller tuning using modified relay feedback method. Journal of Chemical Engineering of 
Japan, 28 , 118. 

Kreyszig, E. (2006) Advanced Engineering Mathematics, John Wiley & Sons, Inc. 

Lee, J., Sung, S.W. and Edgar, T.F. (2007) Integrals of relay feedback responses for extracting process information. 
AIChE Journal, 53 , 2329. 

Sung, S.W. and Lee, I. (1997) Enhanced relay feedback method. Industrial & Engineering Chemistry Research, 36 , 
5526. 

Sung, S.W. and Lee, I. (2000) An improved algorithm for automatic tuning of PID controllers. Chemical Engineering 
Science, 55, 1883. 

Tan, K.K., Lee, T.H. and Wang, Q.G. (1996) Enhanced automatic tuning procedure for process control of PI/PID 
controllers. AIChE Journal, 42 , 2555. 





9 


Process Identification Methods 
for Continuous-Time Differential 
Equation Models 


Two groups of process identification methods to obtain the process model in the form of 
continuous-time differential equation are introduced in this chapter. The first group estimates 
the model parameters using the least-squares method after it converts the continuous-time 
differential equation to the algebraic equation using the time-weighted integral transform. The 
second group estimates the model parameters by solving the nonlinear multivariable optimi¬ 
zation problem of which the objective function is the norm of the modeling error. Numerical 
examples and MATLAB codes for each process identification method are provided. 


9.1 Identification Methods Using Integral Transforms 

The identification method using the integral transform provides the following continuous-time 
time-invariant linear model: 


G( s ) = ^ = bm ^ + bm ~^ n * +- \-bis + b 0 

S u(s) a n s n +a n -\s"~ l + ■ ■ ■ + a\s+l 


(9.1) 


where the transfer function of G{s ) is strictly proper; that is, m < n. u(s ) and y(s) denote the 
Laplace transforms of the process input (i.e. controller output) and the process output 
respectively. Two identification methods are introduced in this section. The first method can 
be applied to the case that the process is initially in a steady state. The second method can 
incorporate the case of the initially unsteady state. 


9.1.1 Identification Method for the Case of an Initially Steady State 

The identification method using the integral transform introduced in this section can be applied 
to the case that the process is initially in a steady state (Sung and Lee, 1999). It can estimate the 
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model parameters with frequency weighting. Consider the transfer function (9.1). It is 
equivalent to the following continuous-time differential equation (9.2). Also, assume that the 
initial values of the process input and the process output are zero and steady state; that is, 
>■(0) = 0, d'“ 'y(mr'\ t=0 = 0, i= 2,...,«, and w(0) = 0, d'“ l u(t)/df -= 0, i = 2,..., m. 


a„ 


d"y(Q 

d t n 


d" l y{i) dy(f) 

__ + ". +a i _ 


+y(‘) 


d m l u(t) 
dr- 1 


+ • • • + b 0 u(t) + B 


(9.2) 


where B represents a bias term to incorporate the case that the deviation variables are not specified 
correctly or a static disturbance enters. If the reference value for the deviation variables is chosen 
correctly, then by setting B = 0 the B value need not be estimated additionally. 

Now, consider the following integral transforms for the signals of y{t), u(t) and b(t)= 1. 


y(.v) = | exp(— st)y(t) dt, u(s) = j exp(- st)u(t) dt, b(s) = j exp(- st)b(t) dt 

(9.3) 

Because y(0) = 0, d z_1 y(f)/dt' _1 l f=0 = 0, i= 2,...,«, and u(0) = 0, d z_1 w(t)/dt z ^ 1 l r=o = 0, 
i=2,...,m, it can be assumed that y(t)l,< 0 = 0, d !_1 y(0/dt !_1 l ? <o = 0, i = 1,2,..., n, and 
u(t) l,<o = 0, d z_1 w(t)/df z_1 l,< 0 = 0, / = 2,..., m. Then, (9.3) is equivalent to 


y(«) 


£ exp(— st)y(t) dt, u(s) = exp(— st)u(t) dt, b(s) = exp(— st)dt (9.4) 

Jo J-7j 


It should be noted that y(s) and u(s) in (9.4) are the Laplace transforms. So, the following 
algebraic equation can be easily obtained by applying the transform to (9.2): 

a n s"y(s) +a n -is"~ 1 y(s) H-haisy^) +y(s) 

= b m ru{s)+b m _ x r- l u{s)+ ••• +b 0 u(s)+Bb(s) (9.5) 

where b(s) = exp(— st) At = JJ° exp[ — sit — f s )] dt. The objective of the process identifi¬ 
cation method is to identify the coefficients of a/ c , k= 1,2,... ,n, and b^, k = 0,l,... ,m. 
To do that, the process input and output data for t > 0 are required for the calculation of y(,y) and 
u(s). Also, b(s) can be obtained by integrating exp[— s(t — 4)] from t = 0 to t = °°. 

Let us choose s in (9.4) like s = a + \w. a is a positive real value. Then, the weight function 
in (9.4) becomes exp(— st) = exp(— at) exp(— icot). Note that the magnitude exp(— at) of the 
weight function decays exponentially to zero as the time increases. Then, the important 
conclusion reached is that y(s) and u(s) in (9.4) can be calculated by integrating exp(—st)y(t) 
and exp(— st)u(t) from zero to a finite value using a numerical integration method. That is: 

y(j) = | exp(- st)y(t) df, u(s) = j exp(- st)u(t) At, b(s) = | exp[- s(t - 4 )] At 


(9.6) 
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where a should be chosen as a positive value that makes exp(— at f ) sufficiently small. For 
example, exp(— at f ) = 0.0001 => a = — ln(0.0001)/t f . co is for a frequency weighting. Detailed 
analysis about the frequency weighting will be provided in the next section. 

How to determine f s ? Consider the step input signal u(t) = 1, t>0 and u{t) = 0, t< 0. 
If t s = 0, then u{s) = exp(— st)u{t) At is the same with b(s) = [“ ( exp(— st) At. This means 
that the independence between u(s) and b(s) cannot be guaranteed. Then, it is impossible to 
estimate the model parameters. So, t s should be large enough to guarantee the independence 
between u(t), t> 0, and b{t ) —l, t>—t s . The recommendation is t s = tf/5. 

Now, let us recommend the procedure and specifications for the process identification 
method using the integral transform (9.5). First, determine a by a = — ln(0.0001)/f f and 
t s = t f /5, where q-is the final time of the activated process input and the process output. Second, 
determine the frequencies <o k , k = 1 , 2 ,.. ., n f , from 0 to oj max by w k = (k — l)<o mayL /(n f — 1), 
where <u max = 1 2n/t f is recommended. Third, calculate the integrals of the transforms y(s k ), 
u(s k ) and b(s k ) in (9.6) for the desired frequencies co k , k= 1,2,... ,n f . Fourth, estimate the 
model parameters (the coefficients of (9.2)) by applying the least-squares method to (9.5). 
A process order of n = 3, m = 2 is recommended because the third-order model can describe 
with acceptable accuracy the dynamics of most processes in process systems engineering. 

Example 9.1 

Consider the following SOPTD process: 

Figure 9.1 shows the activated process outputs by the P controller with a gain of 2. The 15 
desired frequencies chosen are located equally between 0 and 12n/t f . The setpoint is changed 
at t = 0. The system identification method shows good performances, as shown in Figure 9.2. 
The MATLAB code to simulate Example 9.1 is shown in Tables 9.1 and 9.2. nyquist_ 
continuous_ IT_LS0 should be executed after continuous_IT_LS0 is executed. 



Figure 9.1 Activated process output and input by a proportional (P) controller. 
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Figure 9.2 Identification results of the identification method using the integral transform. 


9.1.2 Identification Method for the Case of an Initially Unsteady State 

The process identification method using the integral transform in this section can manipulate 
the case that the process is not initially in a steady state and it can estimate the model parameters 
with frequency weighting. Consider the following transform for the signal y(t ) and u(t): 

[ k d n w(a>, t) d m y(t) 


k Jo d f' dr 



(9.8) 


The weight of w(cd, t) will be explained later in this section. Using integration by parts, 
the following equations can be derived: 


y(« -1,»,«) 

u(n-\,n,a) 


— y(n,n— l,m) + 


-u{n,n-l,(o) + 


d"-y<M f )d"- 1 y(fe) 

dt n ~ 1 dt n ~ 1 

d"- l w((o,tf)d"- l u(tf) 
dt n ~ 1 d t n ~ l 


d”~ 1 w(a>, 0) d”- ‘y(0) 
dt n ~ 1 dt n ~ 1 

d" _1 vr(cu,0)d" _1 M(0) 
d?" - 1 d t n ~ l 

(9.9) 


Equation (9.10) can be obtained from (9.9) if the weight satisfying d k w(<o, Q)/dt k = d k w(u>, 
t f )ldt k = 9,k=\,2 . n- 1. and w(a>, 0) = w(w, t f ) = 0 is chosen. 

y(0,k,(o) = (— \) k y(k,0,(o) and u(0,k,(o) = (— l) k u(k,0,a>) k=l,2,...,n-l (9.10) 


Now, consider the transfer function (9.1). This is equivalent to the following continuous-time 
differential equation: 


a„ 


d”y(Q , „ d” l y(t) dy(t) 


+ ?w=^ +bm _, 


d'” l u{t) 
1 dr- 1 


H- \-bou(t) +B 


(9.11) 
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Table 9.2 MATLAB code to draw Figure 9.2. 

nyquist_continuous_IT_LSO »m 

del_w=0.01; wmax=pi; n=round(wmax/del_w); 
for i=l: n 

*del_w; 

s=j*w; 

gjw=exp(-Di5*s)/(s+1) A 2; 

gjw_P_hat=(P_hat(4)*s A 2+P_hat(5)*s+P_hat(6))/(P_hat(l)*s A 3+ 
P_hat'C2-) *s A 2+P_hat (3) *s+l) ; 

Re (1) =real (gjw) $ $m(i)=imag (gjw) ; 

Re_P_hat (i) =real (gjw_P_hat); Im_P_hat (i) (gjw_P_hat) ; 

end 

figure (2) ; plot (Re, Im, Re_P_hat, Im_P_hat, 


command window 


» nyquist_continuous_IT_LSO 


where B represents a bias term to incorporate the case that the deviation variables are not 
specified correctly or a static disturbance enters. If the reference value for the deviation 
variables is chosen correctly, then by setting B = 0 the B value need not be estimated 
additionally. 

The algebraic equation (9.12) can be obtained by the following two steps. Step 1, multiply 
w((o, t) to (9.11) and integrate the equation from t = 0 to t = t f ; Step 2, convert the algebraic 
equation to (9.12) using (9.10): 

a„(- l)"y(#i,0,m) +a n ^(- l)* _1 y(ii-1,0,®) + • • • +fli( - l)y(l,0,m)+y(0,0,m) 

= b m (-iy n u(m,0,(o) + b m -i(-l) m ~ 1 u(m-l,0,co)+--+b 0 u(0,0,(o)+Bb(0,0,co) 

(9.12) 

where y(0,0, w) = J 0 ' f w((o, t)y(t) At, u( 0,0, w) = J 0 ' f w(w, t)u(t) At and b( 0,0, u>) = J 0 ' f w(w, t ) At, 
and y(k,0,(o) = J Q ,f (d fr w(w,t)/dt fc )y(f)d? and u(k,0,o)) = ^’(A k w((o,t)/At k )u(t)At for 

k=l,2,... ,n. Note that 6(0,0,cu), y(k, 0,w), k = 0 ,1_ ,n, and u(k, 0,w), k = 0,1_ ,m, 

in (9.12) can be calculated for various co values for the given weight w(oj, t). Then, the 
coefficients k = 1,2,..., n, and b^, k = 0, 1,2,..., m, from (9.12) can be estimated using the 
least-squares method. 

The model of n = 3 and m = 2 in (9.1) can represent the dynamics of the usual processes with 
a good accuracy. Then, the weight should satisfy A k w(cu, 0)/At k = dVfw, t f )/At k = 0, k =1,2, 
and w(cd, 0) = w(«j, tf) = 0. Let us introduce two examples for the weight. 

9.1.2.1 Weight Example 1 

Sung et al. 1998 used (9.13) and (9.14) as the weight: 

w(co, t) = g( t, f)exp( — i cot) with a fixed t 


(9.13) 
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g{x,t) =/(1-5t, t) -f(x,t) 


(9.14) 


/(i.St.O-I^^ + ^j^) +^(y^) + ^i(ii) ] exp (“Lk) 

(9.15) 

/(T ’ ?) = t 1 + r + 2! O' + 3! O' + 4! O' + h S'] CXP (- t) (9 ‘ 16) 


where t and oj are related to a time weighting and a frequency weighting respectively. The 
Laplace transform of g(x, t ) =/(1.5r, f) — fix, t) is g(x, s ) = 1 /[.v(t.s + l) 6 ] — 1 /[.v( 1 .5 t.v + l) 6 ]. 
I/IXts + 1 ) 6 ] and 1 /[.y( 1,5r.s + 1 ) 6 ] are the step responses of the fast process G(s) = 1 l(xs + l) 6 
and the slow process G(s) = 1/(1.5tv + 1 ) 6 respectively. So, g(x, t) =fi 1.5i, t) —fix, t) satisfies 
the conditions of d fr g(r, t)/dt k \ t _ Q = d k g(x, t)/dt k \ t=tf = 0, k= 1,2,..., 5 and g(x, 0) = g(x, 
tf) = 0 if tf/x is big enough. g(x, t) = /( 1,5t, t) —fix, t ) determines the magnitude of the weight. 
So, the weight also satisfies the required conditions of d k w{(», 0)1 dt k = A k w{(o, fi)ldt k = 0, 
k= 1, 2,..., 5 and w(w, 0) = w(w, t f ) = 0. 

It is straightforward to derive the following derivatives of the weight: 

dH ^’ ^ = dg ^’ exp(- i (ot) + g(x, t) (- i<w)exp(— i wt) (9.17) 


d 2 w(w, t) 
d t 2 


= d ~ ex P(“ i(ot ) + 2 ^ ^ (- i")exp(- i wt) 

■jr g(x, t)(- i<u) 2 exp(— i wt) 


(9.18) 


d 3 w(ta,t) 

dt 3 


d 3 g(t, t) 
dt 3 


exp(— iw) 


+ 3 


d 2 g(T, t) 
d t 2 


(— W)exp(— i wt) 


3 dg(r, t) 
d t 


(— ko) 2 exp(— i (at) + g(x, t)(— itu) 3 exp(— i wt) 


(9.19) 


where the derivatives of g(x, t) =/( 1 .5t, t) —fix, t) can be obtained by (9.20)-(9.23): 


d/(T, t) = _ J_ /A s exp(-t/r) 

d t 120 Vt ) x 


(9.20) 


d 2 /( T , Q _ [_ J_/£\ 4 J_X\ 5 1 ex P(~ t/x) 

d f- '[ 24 \x) 120 Vt/ J t 2 


- l ( t V i 1 fV 1 /?V 5 1 ex P(-^A) 

6 U 12 W 120 Vt ) \ t 3 


(9.21) 


d 3 /M) 

d/? 


(9.22) 
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9.1.2.2 Weight Example 2 

Polynomials can be a candidate for the weight (Sung et al., 2001). Consider the following 
weight: 

w{w, t) = g{t , t f )exp( - it oi) (9.23) 

(9.24) 

where t f is the final time. It is straightforward to derive the following derivatives of the weight: 

dlt ^ ^ ^ j^ ex P(~ iw 0 +S(t, tf){~ iw)exp( - i .at) (9.25) 


d t 1 d t 2 


(9.26) 


dt 3 df 3 


dt 2 


- (— i<w) 2 exp(— i(ot) + g(t , /f)(— iw) 3 exp(— i cot) 

The derivatives of g(t , tf )are as follows: 

dg(t,tf) 4 t 3 (t-t f ) 4 4 t 4 (t-t { ) 3 

d t -.'ifs 

d 2 g(Mr) _ 12t 2 (t — f f ) 4 32 t 3 (t-t f ) 3 12t 4 (t-t f ) 2 


(9.27) 


(9.28) 


(9.29) 


ffigfoft) = 24 t (t~tf ) 4 MPfr- t f ) 3 P${t-U) 

' df ' tf if if if ^ ‘ 2 

As shown in (9.28)-(9.30), the derivatives of g(t, i f ) are zero at i = 0 and i = i f . So, the 
weight (9.28)—(9.30) satisfies the required conditions d /c H’(<w, ())/dt k = d k w(w, t f )/dt k = 0, 
k = 1,2,3 and w(tu, 0) = w(tu, i f ) = 0. 

Figure 9.3 shows the magnitudes of the derivatives of the weight 1 for various a> values. 
Roughly speaking, only the signal between i = 0 and the time corresponding to 30 times r 
can pass through the transform. As a result, the signals outside the range from i = 0 to i = 30 t 
are excluded in estimating the model parameters using (9.12). 

Figure 9.4 confirms that only the signal between t = 0 and t=t f can pass through the 
transform. So, the signals outside the range from t = 0 to t = t f are excluded in estimating the 
model parameters using (9.12). 
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Figure 9.4 Magnitudes of the derivatives of weight 2 with t { = 30 for various oj values. 




Figures 9.5 and 9.6 show the magnitudes of the transformed signals using weight 1 and 
weight 2 for the following two signals: 

ui{t) = cos(1.5t) + sin(1.5f) +cos(10t) + sin(10t), u 2 (t) = cos(1.5f) + sin(1.5t) 

(9.31) 
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The plots for U\{t) and u 2 (t) are almost identical even though the high-frequency term cos 
(10?) + sin(10t) is included only in U\(t), meaning that the transform amplifies the signals of 
the specified range of the frequency to (in this case, from co = 0 to cd = 3) and filters out the 
other frequency signals belonging outside the range. So, if the model parameters of the 
algebraic linear equation (9.12) are estimated using the least-squares method for frequencies 
(ai = (o k , k= 1,2,...) within the desired frequency region, then the model parameters will be 
adjusted to approximate mainly the desired frequency region. 

The recommendation is n = 3, m = 2 for the model structure and t = t f /30 for weight 1. 
Also, the desired frequency range from w = 0 to co = I2nlt f is recommended for weight 1 and 
weight 2. Note that the initial part of the setpoint change or relay on-off includes many 
frequency components. So, if the relay feedback method or a proportional controller is used 
to activate the process, then the starting time should be t = 6r for weight 1 and t = t f /3 for 
weight 2 to assign a big weight to the initial part. 

Example 9.2 

Activate the SOPTD process G p (s) = exp(— 0.5s)/(s + l) 2 using a P controller with a gain of 2. 
Also, obtain the process model using the integral transform with weight 1. 

Solution Figure 9.7 shows the activated process output by the P controller with a gain of 2. 
The 10 desired frequencies chosen are located equally between to = 0 and w = 12n/t f . Note that 
the initial process output is not in a steady state. Nevertheless, the process identification method 
shows a good performance, as shown in Figure 9.8. The MATLAB codes to simulate Example 
9.2 are shown in Tables 9.3 and 9.4. 



Figure 9.7 Activated process output and input by a proportional (P) controller. 


Note that y(t) and u(t) are not independent if the setpoint is not changed, because it is a 
closed-loop process activation by the P controller u(t) = k c (y s (t) — y(t)). Then, the least- 
squares method would fail because of the singular problem originating from the dependence 
of y(t) and u(t). So, the process data must include the instance of the setpoint change to 
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Figure 9.8 Identification results of the process identification method using the integral transform 
with weight 1. 


guarantee the independence between y{t) and u(t) for a successful identification. It should also 
be noted that process identification is impossible for the same reason if the setpoint of the 
P controller changes at t = 0. That is, the independence between y(t) and u(t) by the setpoint 
change is eliminated because the weight function assigns a zero weighting to the initial part. 

Example 9.3 

Activate the SOPTD process G p (s) = exp(— 0.5 s)/(s + l) 2 using a biased-relay feedback 
method. Also, obtain the process model using the integral transform with weight 1. The 
measurements of the process output are contaminated by uniformly distributed random noise 
between —0.05 and 0.05. Also, a static input disturbance of 0.1 enters. 

Solution Figure 9.9 shows the activated process output by the biased-relay feedback method. 
The process identification method using weight 1 shows an acceptable robustness for the 
measurement noise and the disturbance, as shown in Figure 9.10. The MATLAB codes to 
simulate Example 9.3 are shown in Tables 9.5 and 9.6. 

Example 9.4 

Activate the SOPTD process G p (.s) = exp(— 0.55)7(5 + l) 2 using a P controller with a gain of 2. 
Also, obtain the process model using the integral transform with weight 2. 

Solution Figure 9.11 shows the activated process output by a P controller with a gain of 2. The 
10 desired frequencies chosen are located equally between to = 0 and a> = I2nlt f . The process 
identification method has a good performance, as shown in Figure 9.12. The MATLAB codes to 
simulate Example 9.4 are shown in Tables 9.7 and 9.8. 

Remark If B = 0 is fixed, then the process identification method would show a poor 
performance for a static disturbance. 









_0(k)+dnw(1)*yy(i)*delt 

(k)+dnw(2)*yy(i)*delt 
_2(k)+dnw(3)*yy(i)*delt 
_3(k)+dnw(4)*yy(i)*delt 
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gl=df_tattl2)-df(2) 
g2=df_tau(3)-df(3) 
g3=df_tau(4)-df(4) 
g4=df_tau(5)-df(5) 
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Table 9.4 MATLAB code to draw Figure 9.8. 

pyquist_continuous_IT_LSl .m 

del_w=0.01; wmax=pi; n=round(wmax/del_w); 
for i=l: n 
w=(jyf) *del_w; 
s=j*w; 

gjw=exp(-0,5*s)/(s+1) A 2; 

gj w_P_ha t=(P_ha t(4)*s A 2+P_hat(5)*s + P_hat(6))/(P_hat(l)*s A 3+P_hat(2) 
x s A 2 i ?_r.at (3) *8+1) ; 

Re (i) =real (gjw) y' =imag (gjw); 

Re_P_hat(i)=real(gjw_P_hat); Im_P_hat(gjw_P_hat); 
end 

figure (2) ; plot (Re, Im, Re_P_hat, Im_P_hat, 


command window 

» nyquist_continuous_IT_LSl 



Figure 9.9 Activated process output and input by an input-biased-relay when the measured data are 
contaminated by the measurement noise. 

9.2 Prediction Error Identification Method 

Sung and Lee (2001) proposed a prediction error identification method to obtain a combined 
deterministic-stochastic continuous-time multi-input-single-output process model with time 
delays. Here, the method is simplified to the case of a deterministic continuous-time single- 
input-single-output process model with time delay. It identifies the model parameters by 
minimizing the prediction error using the Levenberg-Marquardt optimization method with the 
exact derivatives of the objective function with respect to the adjustable parameters. Compared 
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Figure 9.10 Identification results of the process identification method using the integral transform with 
weight 1 in Example 9.3. 

with discrete-time identification methods, it does not suffer from the small sampling time 
or irregular sampling problem. Also, it can be applied to a large sampling time that cannot 
be incorporated by the previous continuous-time approaches using transforms. It can 
also identify the time delay term and the other model parameters simultaneously in a 
systematic way. 

9.2.1 State-Space Process 

Consider the following state-space representation: 

Wg- = Ax(t)+Bu(t-0) (9.32) 

M = Cx{t) (9.33) 

where u(t — 6) and y(t) denote the delayed process input and the scalar process output 
respectively. x(t) is the ^-dimensional state. The objective of this method is to estimate the 
matrices A, B and 6 from the discrete-sampled-output data and the given process input. 


'0 0 0 ••• 0 -On 

1 0 0 ••• 0 -On-1 

0 10-0 -On -2 

0 0 0-0 - fl 2 


(9.34) 


-«i 
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Table 9.6 MATLAB code to draw Figure 9.8. 

pyquist_continuous_IT_LS2.m 

del_w=0.01; wmax=pi; n=round(wmax/del_w); 
for i=l: n 
w= *del_w; 



gj w_P_ha t=(P_ha t(4)*s A 2+P_hat(5)*s + P_hat(6))/(P_hat(l)*s A 3+P_hat(2) 
*s A 2+P_hat(3)*s+l); 

Re (i) =real (gjw) /’ l«i (±) =imag (gjw) ; 

Re_P_hat(i)=real(gjw_P_hat);Im_P_hat(i)-imaq(gjw_P_hat); 
end 

figure (2) ; plot (Re, Im, Re_P_hat, Im_P_hat, 

command window 

» nyquist_continuous_IT_LS2 



(9.37) 
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Figure 9.12 Identification results of the process identification method using the integral transform 
with weight 2. 


For more details on the state-space model, refer to Chapter 1. 


9.2.2 Continuous-Time Prediction Error Identification Method 

The prediction error identification method in this section estimates the model parameters by 
solving the following nonlinear optimization problem: 


min V(A,B,6) = — - y(h)f 


(9.38) 


y(t) = Cx(t ) 

= 0< ft < • • • < t N -1 < t N 


(9.39) 

(9.40) 

(9.41) 


where y{t) and y(t) denote the process output and the model output respectively. To solve 
this optimization problem, the Levenberg-Marquardt method is used, which repeats (9.42) 
until the parameters converge. 


K/)=iK/-i)- 


1)) 

~"'W " 


[ 3V(p(/- i))~ 
. % . 


b\ b 2 


(9.42) 

(9.43) 





ound(delt/subdelt) ; 
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; d3w]; % w(t), dw(t)/dt, d2w(t)/dt2, 
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Table 9.8 MATLAB code to draw Figure 9.12. 

nyquist_continuous_IT_LS3.m 

del_w=0.01; wmax=pi; n=round(wmax/del_w); 
diSr i=l: n 

w=(|i4) *del_w; 
s=j*w; 

gjw=exp (-D.5*s)/ (s+1) A 2; 

gjw_P_hat=(P_hat(4)*s A 2+P_hat(5)*s+P_hat(6))/(P_hat(l)*s A 3+P_hat(2) 
x s A 2 i ?_r.at (3) *8+1) ; 

Re (i) =real (gjw) ? frn (i) =imag (gjw); 

Re_P_hat (i) =real (gjw_P_hat) ; Im_P_hat ( l ) -i.T.gc (gjw_P_hat) ; 
end 

figure (2) ; plot (Re, Im, Re_P_hat, Im_P_hat, 


command window 

» nyquist_continuous_IT_LS3 


where j denotes the iteration number and a is a small positive value that can be updated 
every iteration to compromise between the robustness and the convergence rate. For details, 
refer to Chapter 2. 

The initial values for the Levenberg-Marquardt optimization method can be determined 
roughly by previous approaches. For example, the continuous-time (or discrete-time) high- 
order autoregressive exogenous input (ARX) model using the process identification methods of 
Section 9.1 (or Section 10.2) is obtained and the high-order model can be reduced to a 
continuous-time low-order plus time-delay model using the model reduction (or conversion) 
methods of Section 5.8 (or Chapter 11). Then, the low-order plus time-delay model obtained 
can be used as the initial parameters for the Levenberg-Marquardt optimization method. 

The partial derivatives of the objective function with respect to the adjustable parameters 
in (9.42) can be calculated by the numerical derivative or solving the differential equations. 
Refer to Chapter 2 for the numerical derivative. Consider the following to understand how to 
calculate the partial derivatives by solving the differential equations. 

From (9.38), (9.44) is derived: 


dv(p) 

dp 

--*§<**>-*# 


(9.44) 

\m) 

dy(t) ty(t) ... dy(t) 

mf 

(9.45) 

[ dal 

da n dbi db„ 

de \ 

'tm 

i=i 

dp 1 ^ i=\ Y dp 

IPff 

(9.46) 
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' d 2 X0 

9 2 X0 

9 2 X0 

§§ff|l 

9 2 X0" 

da\ dai 

da\da n 

90i 90| 

9«i90 ff 

90i 90 

9 2 X0 

9 2 X0 

•9 2 v(0 

'^yfOi 

9 2 X0 

da n da\ 

da„da„ 

da n db\ 

da n db n 

90„90 

9 2 X0 

9 2 X0 

9 2 X0 

9 2 y(0 

9 2 X0 

db\dai 

db i da„ 

90i 90i 

90i90„ 

90i 90 


9 2 XQ 

, 9 2 X0 

9 2 y(Q_ 

9 2 X0 

db n da\ 

db n da„ 

90„90i 

db n db n 

90„90 

9 2 X0 

9 2 X 0 

9 2 X0 

9 2 X0 

9 2 X0 

90901 

d0da n 

9090i 

9030„ 

9090 _ 


From (9.39) and (9.40), (9.48)-(9.58) are obtained: 


9X0 

dp 


c 9x(t) &m = c &m 

dp dpfdpj dpfdpj ’ 


,i,j,= 1,2, • • •, 2« + 1 


(9.47) 


(9.48) 


d (m)\ 

d t V da k ) 


da k 


- G k y(t ), 


k= 1,2,... ,n 


(9.49) 


d /9x(0\ 
d t V db k ) 


a 9X0 


G k u(t — 6), 


k= 1,2,... ,n 


(9.50) 


d /3*(o\ _ :x m) B Mt~0) 

dt v do ) do de 


(9.51) 


d =a 9 2 X0_ g ^W _ g 9X0 

d t \daida k ) 90/90* 1 da k k da/ 


k=l,2,...,n l = k,k+ 1,... ,n 

(9.52) 


d 0 9 2 ^(0% ^_ ^ dy(t) 

d t \dbida k ) 90/90* d 0/ 


(9.53) 


d /^(Q\ _ A 3 2 Mi' .' c '%(*) 

d t\dbda k ) 9090* k 30 ’ 


k = 1,2,... ,n 


(9.54) 







Process Identification Methods for Continuous-Time Differential Equation Models 


303 


d (d 2 m\ 

d t \dbidb j 


= 0 , 


k= 1,2 ,l = k,k+ 1,... ,n 


(9.55) 


-f (gg-) = AG k= 1,2,... ,n 
d t \d0dbkJ dOdbk do 

d A <?x(t) 

d 'V W 2 ) 3d 2 


(9.56) 

(9.57) 


a 2 *^) _ 3 2 x{t) 
dcpdip dtpdcp ’ 


(9.58) 


G k = 



has 1 for the n — k+ 1th component and 0 for the others. The initial values of all the 
derivatives of the state x(t) are zero because the parameter of p does not affect the initial 
values of the state. The derivative of u(t — 6) in (9.51), (9.56) and (9.57) with respect to 6 is 
calculated using 


■ #fM) ^ du[t-e) mt-e) = d?u(t-oi 

30 dt ’ 3 1 2 [ ' 

With a numerical derivative, (9.59) can be calculated from the given process input. 

In summary, x(t,-) and all the derivatives of the state are calculated for the given p(j — 1) by 
selecting them at every t t while continuously solving the ordinary differential equa¬ 
tions (9.39) and (9.49)-(9.57) simultaneously. Then, it is straightforward to calculate the 
updated parameters p{j) from (9.42). The whole procedure is repeated until the parameters 
converge. 


Example 9.5 

The following continuous-time process with time delay is simulated to confirm the identifica¬ 
tion performance of the prediction error identification method for the continuous-time 
differential equation model: 


d 2 y(t) 0 d y(t) 
dfi dt 


+y(t) = u(t- 0.5) 


(9.60) 
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Figure 9.13 Process input and output activated by a P controller. 



Figure 9.14 Identification results of the prediction error identification method. 

The process is activated by a P controller for which the setpoint is changed at t = 1. The 
process output is contaminated by uniformly distributed random noise between —0.05 and 
0.05. The sampling time is 0.02. 

Figures 9.13 and 9.14 show the activated process input and output and the identification 
result. Figure 9.14 confirms that the prediction error method provides acceptable performance 
under the circumstance of the measurement noise. 

The MATLAB code to solve the estimation problem in Example 9.5 and draw Figure 9.14 are 
shown in Tables 9.9 and 9.10 respectively. Table 9.9 uses numerical derivatives to calculate the 
partial derivatives 3 2 V(p(j— l))/3p 2 and 3 V(p(j— l))/3 p in (9.42). 
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Table 9.9 MATLAB code to solve the estimation problem using the prediction error 
method in Example 9.5. 

continuous_PEMl.m 

clear; delt=0.02;,f$j$=15; ys=0.0; n=Bptsnd (tf/delt) ; 
al=2.0; a2 = l.0; bl=0.0; b2=1.0; delay=0.5; %process 
C= [0 1] ; x= [0 ; 0] ; y=0.0; u_data=zeros (1,1001) ; 
iter=0; rand('seed',0); noise=(rand(1,n)-0.5)*0.1; 
for 1=1: n 

t=i*delt; yy(i)=y+noise(i); tt(i)=t; yys(i)=ys; 

,^.f (t>l) ys=1.0; end 
[%=2.5* (ys-yy f ||fo 
for j =1:1000 

u_data(j)=u_data(j+1); 
end 

Vp,|j-)=u; u_data (1001) =u; 

[x,y]=g_continuous_PEMl(x,delt,u_data,al,a2,bl,b2,delay); 
end 

figure (1) ; plot (tt, yy, tt, uu) ; legend (' y (t) ' , ' u (t) ' ) ; 

% starting PEM 

al=3,5; a2=^Q;; bl=0.0; b2=1.5; delay=0.0; %initial values of model 
delta=0.0001; del_delay=delt; %interval for the numerical derivatives 
alpha=10.0; index_update=l; 

Pb= [al a2 bl b2 delay] ' ; 

E=object_PEMl(uu,yy,delt,tf,al,a2,bl,b2,delay); 

fprintf (' iteration=%2d al=%6.3f a2=%6.3f bl=%6.3f b2=%6.3f delay=%6.3f 
E=%6.3f\n' , iter, Pb (1) , Pb (2) , Pb (3) , Pb (4) , Pb (5) , E) ; 

while(1) 

,-flf (index_update==l) 

al=Pb (1) ; a2=Pb (2) ; bl=Pb(3); b2=Pb(4); de:ay-Pb(3) ,' 

E=ob ; ject_PEMl (uu, yy, delt, tf, al, a2,bl, b2, delay) ; %object function 
E_al=ibbject_PEMl (uu, yy, delt, tf, al+delta, a2,bl, b2, delay) ; 
E_a2=object_PEMl(uu,yy,delt,4:1,al,a2+delta,bl,b2,delay); 
E_bl=object_PEMl (uu, yy, delt^gfl, al, a2,bl+deltai,,b2, delay) ; 
E_b2=object_PEMl(uu,yy,de:t,tf,al,a2,bl,b2+delta,delay); 
E_delay=object_PEMl(uu,yy,delt,tf,al,a2,bl,b2, delay+del_delay) ; 

E_al_al=obj ect_PEMl(uu,yy,delt,tf,al+2*delta,a2,bl,b2,delay); 
E_a2_a2=object_PEMl(uu,yy,delt,tf,al,a2+2*delta,bl,b2,delay); 
E_bl_bl=object_PEMl(uu,yy,delt,tf,al,a2,bl+2*delta,b2,delay); 
E_b2_b2=object_PEMl(uu,yy,delt,tf,al,a2,bl,b2+2*delta,delay); 
E_delay_delay=object_PEMl (uu, yy, delt/hf., al, a2, bl, b2, delay+2*del_ 
delay); 

E_al_a2=object_PEMl(uu,yy,delt,tf,al+delta,a2+delta,bl,b2,delay); 
E_al_bl=object_PEMl(uu,yy,delt,tf,al+delta,a2,bl+delta,b2,delay); 
E_al_b2=object_PEMl(uu,yy,delt,tf,al+delta,a2,bl,b2+delta,delay); 


f continued ) 
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Table 9.9 ( Continued) 

E_al_delay=ob (tiu, yy, delt^fi§^ al+dei!|jt, a2,bl,b2, delay 

+del_delay); 

E_a2_bl=obj ect_PEMl(uu,yy,delt,tf,al,a2+delta,bl+delta,b2,delay); 
E_a2_b2=obj ect_PEMl(uu,yy,delt,tf,al,a2+delta,bl,b2+delta,delay); 

E_a2_delay=object_PEMl (uu, yy, delt,#^ al, a2+delta, bl, b2, delay 
+del_delay); 

E_bl_b2=object_PEMl(uu,yy,delt,tf,al,a2,bl+delta,b2+delta,delay); 


E_bl_delay=objecb_ftEMl(uu,yy,delt^J^ al, a2, bl+delta, b2, delay 
+del_delay); 

E_b2_delay=object_PEMl(uu,yy,delt,tf,al,a2,bl,b2+delta,delay 
+del_delay); 

dV(l,l)=(E_al-E)/delta; %dV/dpl 
dV(2,l)=(E_a2-E)/delta; %dV/dp2 
dV(3,l)=(E_bl-E)/delta; %dV/dp3 
dV(4,l)=(E_b2-E)/delta; %dV/dp4 
dV(5,1)=(E_delay-E)/del_delay; %dV/dp5 

ddV(1,1)=(E_aLjil~2*E_al+E)/delta A 2; %d A 2V/dpl A 2 

ddV(2,2)=(E_a2_a2-2*E_a2+E)/delta A 2; 

ddV(3,3)=(E_bl_bl-2*E_bl+E)/delta A 2; 

ddV(4,4)=(E_b2_b2-2*E_b2+E)/delta A 2; 

ddV(5,5)=(E_delay_delay-2*E_delay+E)/del_delay A 2; 

ddV(l,2)=(fi_a!_a2-E_al-E_a2+E)/delta A 2; %d A 2V/dpldp2 
ddV(1,3)=(E_al_bl-E_al-E_bl+E)/delta A 2; 
ddV(1,4)=(E_al_b2-E_al-E_b2+E)/delta A 2; 

ddV(1,5)=(E_al_delay-E_al-E_delay+E)/(delta*del_delay); 

ddV(2,3)=(E_a2_bl-E_a2-E_bl+E)/delta A 2; 
ddV(2,4)=(E_a2_b2-E_a2-E_b2+E)/delta A 2; 

ddV(2,5)=(E_a2_delay-E_a2-E_delay+E)/(delta*del_delay); 
ddV(3,4)=(E_bl_b2-E_bl-E_b2+E)/delta A 2; 

ddV(3,5)=(E_bl_delay-E_bl-E_delay+E)/(delta*del_delay); 

ddV(4,5)=(E_b2_delay-E_b2-E_delay+E)/(delta*del_delay); 

ddV(2,1)=ddV(1,2); ddV(3,1)=ddV(1,3); ddV(4,1)=ddV(1,4); ddV(5,l) 

=ddV(1,5); 

ddV(3,2)=ddV(2,3); ddV(4,2)=ddV(2,4); ddV(5,2)=ddV(2,5); 
ddV(4,3)=ddV(3,4); ddV(5,3)=ddV(3,5); ddV(5,4)=ddV(4,5); 
end 

P=Pb-inv(ddV+alpha*eye(5))*dV; 
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Table 9.9 ( Continued) 

";|gp{P(5)<0.0) P (5) =0.0; end 
f|f fP (5) >2.0) P (5) =2.0; end 
al=P(1); a2=P (2); bl=P(3) ; b2=P(4); delay=P(5); 

[E_new yy_m]=6bject_PEMl(uu,yy,delt,tf,al,a2,bl,b2,delay); 
if (E_new<E & P(5)>=0.0) 
alpha=alpha/2.0; Pb=P; 
iter=iter+l; index_update=l; 

fprintt (' it.eration-%2d al=%6.3f a2=%6.3f bl=%6.3£ b2=%6.3f delay=% 
6.3f E=%6.3f\n',iter,P(l),P(2),P(3),P(4),P(5),E); 

index_update=Q; 
alpha=alpha*l.5; 
end 

. : |Lf (iter==20 | alpha>10.0 A 10) break; end 
figure(2); plot(tt,yy,' g? ,tt,yy_m,'k');legend('process','model'); 


g_contiS ? Uous_PEMl. m 

function [next_x,y]=g_continuous_PEMl(x,delt,u,al,a2,bl,b2,delay); 
subdelt~0.OCb; n=round(delt/subdelt); 

A= [0 -a2 ; 1 -al] ; B= [b2 ; bl] ; C=[0 1] ; 
delay_k=round(delay/delt) ; 
for i=l: n 

dx=A*x+B*u(1000-delay_k); 
x=x+dx*subdelt; 


object_PEMl.m 

function [V yy_m] =object_PEMl(uu,yy,delt,tf,al,a2,bl,b2,delay) 
x=[0; 0]; y=0.0; 

U_data=zeros(1,1001) ; n=round(tf/delt) ; 
for : n 

_:i@?i*delt; yy_m(i)=y; ttf^|=t; 
for j=l:1000 

u_data(j)#a_data(j +1); 
end 

u_data.(1001)=uu(i|*| 

[x, y] = x_ccnt:nucus_PEKl (x, delt, u_data,al,a2,bl,b2,delay); 
end 
s=0 ; 

for i=l: length (yy) 

s = s+(yy(i)-yy_m(i)) A 2*deIt; 
end 
V=s ; 


( continued ) 
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Table 9.9 ( Continued) 


m_co»ttaiiOu s_PEMl .m 

function [next_x,y]=m^continuous_PEMl(x,delt,u,al,a2,bl,b2,delay); 
subdeltWfL005; n=round(delt/subdelt); 

A=[0 -a2 ; 1 -al] ; B= [b2 ; bl] ; C=[0 1] ; 
delay_k=rou»d(delay/delt) ; 
lor i=l:n 

dx=A*x+B*u(1000-delay_k); 
x=x+dx*subdelt; 


» cont^^jous_PEMl 

iteration= 0 al= 3,|o® a2= 5,000 bl= 0.000 b2= I .500 delays®.000 E= 3.936 
iteration- 1 al= 3.520 a2= 4.932 bl=-0.068 b2= 1.646 delay= 0.119 E= 3.936 
:• '.eralion- 2 al= 3.554 a2= 4.777 bl=-0.178 b2= 1.930 delay= 0.367 E= 3.492: 
: Lera tier.- 3 al= 3.609 a2= 4.440 bl=-0 . T12 b2= 2.415 delay= 0.693 E= 2.625 
iteration= 4 al- 3.766 a2= 3.854 bl=-0.247 b2= 2.921 delay= 0.825 E= 1.420 
iteration-'5 al= 4.085 a2= 3.271 bl=-0.190 b2= 3.047 delay= 0.816 E= 0.532 


Table 9.11 shows a typical convergence pattern of the prediction error identification method. 
a is updated according to Marquardt’s compromise with the initial value of a = 1.0. For details, 
refer to Chapter 2. Considering the confirmed robustness of the Levenberg-Marquardt method 
and extensive simulation results for various initial settings, it is concluded that the nonlinear 

Table 9.10 MATLAB code to draw Figure 9.10. 

nyquist_continuous_PEMl ,rf.' 

de:_w-0.01; wmax=pi; n=round(wmax/del_w); 
for i=l: n 

w= (iM-) *del_w; j-comp : ex (0,; s=j*w; 
gjw=exp(-0.5*s)/ (s + 1) A 2; 

gjw_model=(bl*s+b2)*exp(-delay*s)/(s A 2+al*s+a2); 

Re(i)=real(gjw); Im(i)=imag(gjw); 

Re_model(i)=real(gjw_model); 

Im_model (i) -i.naq (gjw_model) ; 
end 

figure (1) ; p|s$j|(Re£ itti, Re_model, Im_model, 


command window 


» nyquist_continuous_PBifi 
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Table 9.11 Typical convergence pattern for the prediction error identification method. 


iteration= 0 al= 3.500 a2= 5.000 
iteration 1 al= 3.520 a2= 4.932 
iteration* 2 al= 3,554 a2= 4.7fT 
iteration* 3 al= 3.609 a2= 4.440 
iteration* 4 al- 3.766 a2= 3.854 
itesation* 5 al* 4.085 a2 = 3.271 
iteration* 6 al* 4.398 a2= 2.924 
iteration* 7 al* 4.629 a2= 2.616 
iteration* 8 al* 4.733 a2= 2.415 
iteration* 9 al®4.714 a2= 2.315 
iteration=10 al* 4.568 a2= 2. 
its@&tion=ll al* 4.233 a2= 2.058 
iteration=12 al* 3.380 a2= 1.648 
iteration=13 al* 2.181 a2= 1.067 
iteration=14 al= 1.860 a2= 0.934 
ite£ation=15 al* 1.861 a2= 0.933 
iteration=16 al* 1.861 a2= 0.933 


bl= 0.000 b2= 1 ..500 delay* 0.000 E= 
*-0.0 68 b2= 1.64 6 delay* 0.119 E= 
bl=-0.178 b2= 1.930 delay* 0.367 E= 
bl=-0.272 b2= 2.415 delay* 0.693 E= 
bl=-0.247 b2= 2.921 delay* 0.825 E= 
bl=-0.190 b2= 3.047 delay* 0.816 E= 
bl=-0.145 b2= 2.845 delay* 0 .775 E= 
bl=-0.119 b2= 2.606 delay* 0.734 E= 
bl=-0.124 b2= 2.436 delay* 0.696 E= 
bl=-0.157 b2= 2.346 delay* 0.666 E= 
bl=-0.206 b2= 2.252 delay* 0.643 E= 
bl=-0.175 b2= 2.086 delay* 0.632 E= 
bl=W§tll4 b2= 1.666 delay* 0.592 E= 
bl*-0.149 b2= 1.070 delay* 0.446 E= 
bl=-0.12 9 b2= 0.931 delay* 0.346 E= 
bl=-0.130 b2= 0.930 delay* 0.343 E= 
bl=-0.130 b2= 0.930 delay* 0.340 E= 


3.936 
3.936 
3.492 
2.625 
1.420 
0.532 
0.201 
0.090 
0.037 
0.025 
0.025 
0.024 
0.023 
0.019 
0.015 
0.012 
0.012 


optimization method gives acceptable robustness if the initial settings are roughly close to the 
true values. 

Example 9.6 

Repeat Example 9.5 with a sampling time of 0.1. 

Figures 9.15 and 9.16 show the activated process input and output and the identification 
result. Figure 9.16 confirms that the prediction error method provides acceptable performance 
under the circumstance of the measurement noises. 

The MATLAB code to solve the estimation problem in Example 9.6 and draw Figure 9.16 
are shown in Tables 9.12 and 9.13 respectively. 



Figure 9.15 Process input and output activated by a P controller with a sampling time of 0.1. 
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Table 9.12 ( Continued) 

alpha=10.0; index_update=l; 

Pb= [al a2 bl b2 delay] ' ; 

E=object_PEM2(uu,yy,sub_delt,tt,al,a2,bl,b2,delay); 

fprintf (' iteration=%2d al=%6.3f a2=%6.3f bl=%6.3f b2=%6.3f delay=%6.3f 
E=%6.3f\n' , iter, Pb (1) , Pb (2.) , Pb (3) , Pb (4) , Pb (5) ,E) ; 

while (1) 

“if-f (index_update==l) 

al=Pb (1) ; a2=Pb (2) ; bl=Pb(3); b2=Pb(4); delay=Pb(||* 

E=objfeet_PEM2(uu,yy,sub_delt,tt,al,a2,bl,b2,delay); %object 
function. 

E_al=object_PEM2(uu,yy,sub_deltJyh;t,al+delta,a2,bl,b2,delay); 
E_a2=object_PEM2(uu,yy,sub_delt,tt,al,a2+delta,bl,b2,delay); 
E_bl=object_PEM2(uu,yy,sub_delt,tt,al,a2,bl+delta,b2, delay) ; 
E_b2=object_PEM2 (uu,yy, sub_de 1 t, t.t., a". , a2, bl, b2 4 -de 1 Ua, delay) ; 
E_delay=object_PEM2(uu,yy,sub_delt,tt,al,a2,bl,b2,delay! 
del_delay); 

E_al_al=object_PEM2(uu,yy,sub_delt,tt,al+2*delta,a2,bl,b2,delay); 
E_a 2_a2=objec t_PEM2(uu,yy,sub_delt,tt,al,a2+2*delta,bl,b2,delay); 
E_bl_bl=object_PEM2(uu,yy,sub_delt,tt,al,a2,bl+2*delta,b2,delay); 
E_b2_b2=object_PEM2(uu,yy,sub_delt,tt,al,a2,bl,b2+2*delta,delay); 
E_delay_delay=object_PEM2(uu,yy,sub_del:tibt,al,a2,bl,b2,delay! 
2*del_delay); 

E_al_a2=object_PEM2(uu,yy,sub_delt,tt,al!delta,a2!delta,bl,b2, 
delay); 

E_al_bl=object_PEM2(uu,yy,sub_delt,tt,alldelta,a2,blidelta,b2, 
delay); 

E_al_b2=object_PEM2(uu,yy,sub_delt,tt,alldelta,a2,bl,b2idelta, 
delay); 

E_al_delay=object_PEM2(uu,yy,sub_delt,tt,alldelta,a2,bl,b2,delay! 
del_delay); 

E_a2_bl=object_PEM2 (uu, yy, sub_delt, tt, al, a2-de : ta, bl -de :.ta ? b2, 
delay); 

E_a2_b2=object_PEM2(uu,yy,sub_delt,tt,al,a2idelta,bl,b2idelta, 
delay); 

E_a2_delay=object_PEM2(uu,yy,sub_delt,tt, al, a2idelfegybl, b2, delay! 
del_delay); 

E_bl_b2=object_PEM2(uu,yy,sub_delt,tt,al, a2,blidelta,b2idelta, 
delay); 

E_bl_delay=object_PEM2(uu,yy,sub_delt,tt, al,a2,blidelta, b2, delay! 
del_delay); 


( continued ) 
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Table 9.12 ( Continued) 

E_b2_delay=object_PEM2(uu,yy,sub_delt,tt,al,a2,bl,b2+del$j|| delay+ 
del_delay); 

dV(l,l)=(E_al-E)/delta; %dV/dpl 
dV(2,l)=(E_a2-E)/delta; %dV/dp2 
dV(3,l)=(E_bl-E)/delta; %dV/dp3 
dV(4,1) = (E_b2-E) /delta; %dV/dp4:. 
dV(5,1)=(E_delay-E)/del_delay; %dV/dp5 

ddV(1,1)=(E_al_al-2*E_al+E)/delta A 2; %d A 2V/dpl A 2 

ddV(2,2)=(E_a2_a2-2*E_a2+E)/delta A 2; 

ddV (3,3) = (E_bl_bJ?-:i*E_bl+E) /delta A 2; 

ddV(4,4)=(E_b2_b2-2*E_b2+E)/delta A 2; 

ddV(5,5)=(E_delay_delay-2*£_delay+E)/del_delay A 2; 

ddV(1,2)=(E_al_a2-E_al-E_a2+E)/delta A 2; %d A 2V/dpldp2 
ddV(1,3)=(E_al_bl-E_al-E_bl+E)/delta A 2; 
ddV(1,4)=(E_al_b2-E_al-E_b2+E)/delta A 2; 

ddV(1,5)=(E^al_delay-E_al-£_delay+E)/(delta*del_delay); 

ddV(2,3)=(E_a2_bl-E_a2-E_bl+E)/delta A 2; 
ddV(2,4)=(E_a2_b2-E_a2-E_b2+E)/delta A 2; 

ddV(2,5)=(E_a2_delay-E_a2-E_delay+E)/(delta*del_delay); 
ddV(3,4)=(E_bl_b2-E_bl-E_b2+E)/delta A 2; 

ddV(3,5)=(E_bl_delay-E_bl-E_delay+E)/(delta*del_delay); 

ddV(4,5)=(E_b2_delay-E_b2-E_delay+E)/(delta*del_delay); 

ddV(2,1)-ddV(1,2); ddV(3,1)=ddV(1,3); ddV(4,1)=ddV(1*4); ddV(3,l)= 
ddV(1,5); 

ddV(3,2)=ddV(2,3); ddV(4,2)=ddV(2,4); ddV(5,2)=ddV(2,5); 
ddV(4,3)=ddV(3,4); ddV(5,3)=ddV(3,5); ddV(5,4)=ddV(4,5); 

P=Pb-inv(ddV+alpha*eye(5))*dV; 

^f ; |p(5)<0.0) P (5) =0.0; end 
'if C;P (5) >2.0) P (5) =2.0; end 

al=P(1) ; a2=P(2) ; bl=P(3) ; b2=P(4) ; delay=P(5) ; 

[E_new yy_m] -cb';ec:._?EM2 (uu, yy, sub_delt, tt, al, a2,bl, b2, delay) ; 
if (E_new<E & P(5)>=0.0) 
alpha=alpha/2.0; Pb=P; 
iter=iter+l; index_update=l ; 

fprintf V iteration=%2d al=%6.3f a2=%6.3f bl=%6.3f b2=%6.3#-. 
delay=%6.3f E=%6.3f\n', iter, P (1) ,P(2),P(3),P(4) ,P(5) ,E); 

index_update=0:; 
alpha=alpha*l.5; 
end 

'|lf (1 re i -20 | a : pha>I C . 0 A 1C) break; end 
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Table 9.12 ( Continued ) 


figure (2) ; plot (tt, yy, ' yy_m>, ftic') ; legend ('process' , 'model' ) ; 


g_continuous_PEM2 .rf; 

functftgp [next_x, y] =g_C8®M5§|j|ious_PEM2 (x, sub_delt, u, al,a2,bl,b2, 
delay); 

sub_subdelt=0.005; n=round(sub_delt/sub_subdelt); 

A=[0 -a2 ; 1 -al] ; B= [b2 ; bl] ; C=[0 1] ; 
delay_k=round (delay/sub_delt) $ 
for i=l: n 

dx=A*x+B*u(1000-delay_k); 
x=x+dx*sub_subde 
end 


object_PEM2.m 

function [V yy_m]=ob 3 ect_PEM2(uu,yy,sub_delt,tt,al,a2,bl,b2,delay) 
x=[0; 0]; y=0.0; u_data=zeros(1,1001); 

k=l; m=length(tt); tf=tt(m); n=round(tf/sub_delt)+1; s=0.0; 
for : n 

ub_de l|ifr 
for J*=l: 1000 
fi_data(j)^u_daia(j+1); 
end 

if(k<=m& abs(t-tt(k))<sub_delt/2.1) 

■ *.|_f (k<m) s=s+ (yy (k) -y) A 2* (tt (k+1) -tt (k) ) ; end 
yy_m(k)=y; u=uu(k); 
end 

u_data(1001)=u; 

[x, y] s=«i_continuous_PEM2 (x, sub_delt, u_data, al, a2, bl, b2, delay) ; 
end 
V=s ; 


m_continuous_PEM2.m 

function [next_x,y]=m_continuous_PEM2(x,sub_delt,u,al,a2,bl,b2, 
delay); 

sub_sucdelt-0.005; n=round(sub_delt/sub_subdelt); 

A= [0 -a2 ; 1 -al] ; B= [b2 ; bl] ; C=[0 1] ; 
delay_k=round(delay/sub_delt); 
for i=l: n 

dx=A*x+B*u(1000-delay_k); 
x=x+dx*sub_subdelt; 
end 

next_x=x; y=C*x; 
return 


( continued ) 
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Table 9.12 ( Continued ) 


command window 


» continuous_PEM2 

iteration= 0 al= 3.500 a2= 5.000 bl= 0 
iteration= 1 al= 3.521 a2= 4.932 
: Leration- 2 al= 3.556 a2= 4.779 bl=-0 
iterat : iOn= 3 al= 3.617 a2= 4.443 bl=-0 
: ceralion- 4 al- 3.775 a2= 3 .855 bi—C 
iteration= 5 al= 4.104 a2= 3.263 
iteration= 6 al= 4.422 a2= 2.901 
iteration= 7 al= 4.646 a2= 2.602 bl=-0 
: cera Li or.- 8 al= 4.745 a2= 2.398 bl=-0 
iterations 9 al= 4.714 a2= 2.296 bl=-Q 
iteration^ 0 al= 4.557 a2= 2.199 bl=-0 
iteration=ll al= 4.164 a2= 2.002 cl—0 
iteration=12 al= 3.096 a2= 1.496 bl=-#.. 
:-_eration--. 3 afr 2.218 a2= 1.083 cl—0 
iterat'ifen=A ; ai= 1.678 a2= 0.840 bl=-0 
: Leralior.-". 5 al = 1.762 a2= 0.897 bl=-0 
iteration=l6 al= 1.774 a2= 0.893 Bl:-~i$ 


000 b2= 1.500 delay= 0.000 E= 3.912 
0 67 b2= 1.64 4 delay= 0.119 E= 3.912 
177 b2= 1.926 delay= 0.368 E= 3.47 3 
280 b2= 2.400 delay= 0.64 8 E= 2.616 
25% b2= 2.912 delay= 0.847 E= 1.467 
193 b2= 3.034 delay= 0.804 E= 0.54 6 
167 b2= 2.824 delay= 0.7 51 E= 0.20 9 
0 98 b2= 2.591 delay= 0.7 30 E= 0.093 
110 b2= 2.420 delay= 0.679 E= 0.041 
164 b2= 2.327 delay= 0.648 E= 0.029 
197 b2= 2.230 delay= 0.630 E= 0.028 
215 b2= 2.029 delay= 0.597 E= 0.028 
143 b2= 1.509 delay= 0.534 E= 0.026 
132 b2= 1.085 delay= 0.423 E= 0.020. 
156 b2= 0.834 delay= 0.266 E= 0.015 
041 b2= 0.8 90 delay= 0.413 E= 0.013 
145 b2= 0.888 delay= 0.272 E= 0.013 


The simulations of Examples 9.5 and 9.6 exemplify that the prediction error identification 
method shows good results for small and large sampling times. Also, it can incorporate an input 
time delay efficiently. Previous continuous-time approaches using integral or delta transforms 
cannot be applied to large sampling times because the numerical integration or the derivative of 
the process output is not accurate for a large sampling time. 


Table 9.13 MATLAB code to draw Figure 9.12. 

nyquis t_COft^nU0us_PEM2 . r|;;. 

de'._w-0 . 01; wmax=pi; n=round (wmax/del_w) ; 
for i=l: n 

w= (i —1) *del_w; j=complex (0, A.) 3 s=j *w; 
gjw=exp(-0.5*s)/(s+l) A 2; 

gjw_model=(bl*s+b2)*exp(-delay*s)/(s A 2+al*s+a2); 
Re(i)=real(gjw); Im(i)=imag(gjw); 

Re_model(i)=real(gjw_model); 
jfm_model(i)=imag(gjw_model); 

figure (1) f p^B»^(Reyt#, Re_model, Im_model, 


command window 
» nyquist_continuous_PEM2 
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9.2.3 Concluding Remarks 

A continuous-time prediction error identification method was introduced for continuous-time 
processes with time delay. This has advantages compared with previous continuous-time and 
discrete-time identification methods, since it can incorporate small, large and irregular sampling 
times and input time delays as well. However, solving the nonlinear optimization problem using 
the Levenberg-Marquardt method is a disadvantage compared with other process identification 
methods using the least-squares method. 


Problems 

9.1 Activate the process using the following PI controller and estimate the model using the 
identification method in Section 9.1 for the case of an initially steady state. Compare the 
Nyquist plot of the model with that of the process. 




u { t - 0.1) 


u{t) = 1.5(y s (0 -y(t)) + 3 o! o (^tT) -yCO) dr 


d 2 y(l) _ dy(/) 

W 1 , „ d t , 0 


y(0)=0, u(t) = 0 for f < 0 


y s = 1.0 fort>0 and y s = 0.0for<0 

9.2 Tune the PID controller using the ITAE-2 tuning rule for the model obtained in Problem 
9.1 and simulate the control performance. 

9.3 Determine if you can apply the identification method in Section 9.1 for the case of an 
initially unsteady state. Justify your conclusion. 

9.4 Activate the process using the following PID controller and estimate the model using the 
identification method in Section 9.1 for the case of an initially unsteady state. Compare 
the Nyquist plot of the model with that of the process. 


d 3 y(0 d 2 y(i) 

dfi dfi 


, dy(Q 

At 


+y(0= -o.i 


dH(f-O.l) 

df 


u{t — 0.1) 


»(<) = - y ( 0 ) + !! jW) -yW) di+os ^L y(,)) - 0.3 

^L = °, y(o) = - 0.3, u(i) = 0, «o 

y s = 1.0 fort >5 and y s — 0.0 fort<0 


9.5 Tune the PID controller using the ITAE-2 tuning rule for the model obtained in 
Problem 9.4 and simulate the control performance. 
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9.6 Activate the virtual process of Process 3 (refer to the Appendix for details) using a biased- 
relay and obtain the model using the two identification methods in Section 9.1. 

9.7 Tune the PID controller using the ITAE-2 tuning rule for the model obtained in Problem 
9.6 and show the control performance for the virtual process. 

9.8 Estimate the model using the prediction error identification method in Section 9.2 for the 
activated process output and input data of Problem 9.1. Compare the Nyquist plot of the 
model and that of the process. 

9.9 Activate the process of Problem 9.1 with a sampling time of 0.2 and estimate the model 
using the prediction error identification method in Section 9.2 for the activated process 
output and input data. Compare the Nyquist plot of the model and that of the process. 

9.10 Activate the virtual process of Process 3 (refer to the Appendix for details) using a biased- 
relay and obtain the model using the prediction error identification method in Section 9.2. 
In the case, determine the initial estimates using the Fourier transform or the modified 
Fourier transform. 

9.11 Tune the PID controller using the ITAE-2 tuning rule for the model obtained in Problem 
9.10 and show the control performance for the virtual process. 
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Process Identification Methods 
for Discrete-Time Difference 
Equation Models 


10.1 Prediction Models: Autoregressive Exogenous Input Model and 
Output Error Model 

Prediction models are used to predict the future process output on the basis of the past process 
input and/or past process output. In this section, two types of discrete-time prediction model are 
introduced. One is the ARX model and the other is the output error (OE) model. Various discrete¬ 
time difference models have been used for modeling of a process. The most useful in process 
systems engineering are the ARX model and the OE model. Other discrete-time difference 
models, such as the autoregressive, moving-average, exogenous input (ARMAX) model and the 
autoregressive, integrated-moving-average, exogenous input (ARIMAX) model, are useful for 
noisy environments. All the models for noisy processes assume that the noise is white noise. But 
noise in process systems engineering is small and uncertainties such as disturbances and noises are 
also quite different from white noise. Also, the models for noisy environments have complicated 
structures compared with an ARX or OE model. So, the ARX model and OE model are more 
useful for most cases in process systems engineering than the other more complicated models. 

10.1.1 Autoregressive Exogenous Input Model 

The ARX model has the following model structure: 

y{kAt)= -d 1 y((k-l)At)-d 2 y((k-2)At) - a n y{{k-n)At ) 

+ b l u((k-l-d)At) + b 2 u((k-2-d)At)+ ••• + b„u((k-n-d)At)+B 1 ' 

where At is the sampling time, d is the number of the sampling time corresponding to the time 
delay. That is, dAt is the time delay, n is the model order. y(kAt) and u(kAt) are the measurements 
of the process output and the process input at the /cth sampling. The model output y(kAt') is the 
predicted process output at the Ath sampling. The coefficients of d, a, (i = 1,2,... ,ri) and 
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bj (i = 1,2,..., n) are the model parameters of the ARX model. As shown in (10.1), y(kAt) 
depends on the past process output y((k — 1 )At), y((k — 2)Af), .y((k — n)At)) and the past 
process input u( (k— 1 — d)At),u((k — 2 — cl) At ),..., u( (k — n — d) At). It should be noted that 
a one-step-before process output y((k — 1 )At) is needed to estimate the model output y(kAt) .That 
is, the ARX model can only predict a one-step-ahead process output. So, it can be said that the 
ARX model is a one-step-ahead predictor. 

10.1.2 Output Error Model 

The OE model has the following structure: 

y(kAtjm - diy((k - l)At) - d 2 y((k-2)At) - a„y((k-n)At) 

+ biu((k - 1 - d)Ai) + b 2 u{{k - 2 - d)At) + • • • + b„u{{k - n - d)At) +B 1 > 

where At is the sampling time, d is the number of the sampling time corresponding to the time 
delay. That is, dAt is the time delay, n is the model order. u(kAt) is the measurement of the 
process input at the Ath sampling. The model output ofy(fcAt) is the predicted process output at 
the A'th sampling. The coefficients of d, $j(i = 1,2,...,«) and (i = 1,2,..., n) are the model 
parameters of the OE model. As shown in (10.2), y{kAt) depends on the past model output 
y((k — l)Af), y((k — 2)At), ..., y((k — n)At) and the past process input u{{k - 1 — d)At), 
u((k — 2 — d)At), ..., u((k — n — d)At). It should be noted that all the model output in the 
future can be estimated only if the process input is known. So, it can be said that the OE model is 
a multistep-ahead predictor. 

Example 10.1 

Consider the following ARX and OE models: 

ARX model: y(kAt) = 0.5 y((k - 1)A t) + u((k - 2)A t) + 0.2 (10.3) 

OE model: y(kAt) = 0.5y((k— l)Af) +u((k — 2)At) +0.2 (10.4) 

Table 10.1 shows the predicted process outputs (model output) for the given process input 
and the process output. Table 10.2 is the MATLAB code for Table 10.1. The initial values of the 


Table 10.1 

Prediction results of an 

ARX model and an OE model. 


Sampling k 

Process input u(kAt) 

Process output y(kAt) 

Prediction (model output, y(kAt)) 

ARX OE 

1 

0 

0.2300 

Not available 

0.2300 (initial value) 

2 

0 

0.1600 

Not available 

0.1600 (initial value) 

3 

2 

0.3000 

0.2800 

0.2800 

4 

2 

0.3800 

0.3500 

0.3400 

5 

2 

2.2500 

2.3900 

2.3700 

6 

0 

3.0500 

3.3250 

3.3850 

7 

0 

4.2000 

3.7250 

3.8925 

8 

1 

2.0000 

2.3000 

2.1463 

9 

1 

1.5700 

1.2000 

1.2731 

10 

1 

1.6500 

1.9850 

1.8366 
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Table 10.2 MATLAB code to simulate Table 10.1. 


arx_oe_predictiong||\ 

1 Command window 

y= [0.23 0.16 0.30 0.38 2.25 3.05 4.20 

y_arx = 

oe_prediction 

2.00 1.57 1.65 ]f 

0.2300: 

0.1600 

0.2800 

u= [0022200111]; 

0.3500 

2.3900 

3.3250 

y_arx(1)=y(1); y_arx(2)=y(2); %dummy 

setting 

for i=3 :10 

y_arx(i)=0.5*y(i-l)+u(i-2)+0.2; 

3.7250 
1.9850; 

y_oe = 

2.3000 

1.2000 

end 

0.2300 

0.1600 

0.2800 

y_oe(1)=y(1); y_oe(2)=y(2); %initial 

0.3400 

2.3700 

3.3850 

for i=3 :10 

y_oe (i) =0.5*y_oe (i-^fu (i-2) 

+ 0.2; 

end 

y_arx 

y_oe 

plot(1:10,y_arx,1:10,y_oe,1:10,y); 
legend('ARX','OE' , ' Process Output'); 

3.8925 

1.8366 

2.1463 

1.2731 


OE model are chosen as the process outputs. It should be noted that the ARX model can predict 
only as much as one sampling time because it requires the process output before one sampling 
time. Meanwhile, the OE model can predict without limit only if the process input is given 
because it uses the model output. So, the ARX model is a one-step-ahead predictor and the OE 
model is a multistep-ahead predictor. 


10.2 Prediction Error Identification Method for the Autoregressive 
Exogenous Input Model 

The prediction error identification method to identify the ARX model estimates the 
model parameters by minimizing the prediction error of the ARX model (Ljung, 1987). 
It solves the following optimization problem to obtain the model parameters from the 
discrete-sampled-data y(iAt), i = d + n+ 1, • • • ,N, and known u(t). The objective function 
of (10.5) is the norm of the one-step-ahead prediction error. 


V(di, ■ ■ ■ ,a n ,b\,- ■ ■ ,b n ,d,B) = 


E (^-AO-^-AO) 2 


subject to 
ARX model (10.1) 


(10.5) 
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where y(iAt ) and y(iAt) denote the process output and the model output respectively. It should 
be noted that, \fd is given, the model parameters a\, ■ ■ ■ ■ ■ ■ b n .B can be estimated using 

the least-squares method. If d is not given, then the model parameters a\ , • • •, a„ , b\ , • • •, b n , d, B 
should be estimated by solving the nonlinear optimization problem (10.5). 

10.2.1 Case 1: Time Delay is Known 

Assume that the time delay of dAt is known. Then, the optimization problem (10.5) becomes 
the following form: 


V(a u ---,a„,b u ---,b n ,B) =- 


£ (y(iAt)-y(iAt)f 


subject to 

ARX model (10.1) (10.6) 

Note that all the measurements of the right-hand side of (10.1) are available and (10.1) 
is a linear form with respect to the model parameters. So, the optimization problem (10.6) 
can be solved in a straightforward manner by applying the least-squares method to (10.1). 
For a detailed description of the least-squares method, refer to Chapter 2. The solution 
of (10.6) is 


p= [<5 t O]" 1 [O t 7] (10.7) 

where/) = [d\ ••• a„ b\ ••• b„ B ] T are the model parameters, and the matrices are 

as follows: 

<P\,k = -y((k~l)At), •••. <p nk = -y((k-n)A0 

<p n + lk = u((k — d— l)At), ■ ■ ■, (p n+nk = u((k —d— n)At), (p 2n+lk = 1 


’ Td+n 


,d+n 

Vld+n 

Vln+lj + n 

yd+n+ 1 

, o = 

( Pl 1 d +„+1 

< f > 2,d + n+ 1 

^2 n+ 1 ,d + n+ 1 

. yN _ 


. <Pl ,N 

<P2,W 

‘Pln + l.N 


Y, <P and p are an (N— n + 1) x 1 vector, (N — n + 1) x (2 n + 1) matrix and (2 n + 1) x 1 
vector respectively. 


10.2.2 Case 2: Time Delay is Unknown 

Assume that the time delay of dAt is unknown. Then, the optimization problem (10.5) should 
be solved. The optimization problem (10.5) can be rewritten (10.10) using the optimal solution 
of Case 1: 
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(y(iAt) — y(z'Af)) 2 J subject to 

(10.7) and ARX model (10.1) (10.10) 

To solve the optimization problem, the interval-halving method can be used because (10.10) 
is a one-dimensional nonlinear optimization problem. In this case, it should be noted that d is an 
integer. So, the real number chosen by the interval-halving algorithm should be converted to the 
closest integer number for every iteration and the termination condition should be changed. For 
the detailed code to reflect this, refer to the Example 10.2. 

Example 10.2 

The following continuous-time process with time delay is simulated to confirm the identifica¬ 
tion performance of the prediction error identification method for the discrete-time difference 
equation model of the ARX model: 

+,(,)=„(,— 0.5) (10.11) 

The process is activated by the P controller, for which the setpoint is changed from 0 to 1 at 
t = 1 and from 1 to 0 at t = 7. The sampling time is 0.1. Figure 10.1 shows the activated process 
input and output. 


V(d) 


; E 

i=d + n+ 1 



Figure 10.1 Activated process input and output by a P controller. 


10.2.1 Autoregressive Exogenous Input Model for the Case that the Time 
Delay is Known 

The time delay of the process is 0.5 as shown in (10.11). So, the number of the sampling 
time corresponding to the time delay is 5. And, the order of the process is 2 and it is 
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assumed that the bias term of B = 0 is known. Then, the discrete-time ARX model should 
be chosen as (10.12). 

y(kAt) = -aiy((k-l)At)-a2y((k-2)At) + b l u((k-6)At) + b 2 u((k-l)At) (10.12) 

The model parameters of the ARX model obtained by the prediction error identification 
method of (10.7) are a x = - 1.8107394, a 2 = 0.8197907,4 = 0.0028756 ,b 2 = 0.0061637. 
The MATLAB code is shown in Table 10.3. 

Table 10.3 MATLAB code to estimate the ARX model using the least-squares method. 

PEM_arxl.m 

clear; delt=0.1; sub_delt=0.02; tf=15; tref=-delt+sub_delt; ys=0.0; 
n=round(tf/sub_delt); 

al=2.0; a2=l.0; bl=0.0; b2=1.0; delay=0.5; %process 
C=[0 1]; x= [0 ; 0]; y=0.0; u_data=zeros(1,1001); u=0.0; 
k=0; rand('seed',0); noise=(rand(1,n)-0.5)*0.0; 
for i=l:n 

ispi*sub_delt; tt (i) ym-y+noise (i) ; yy(i)=ym; yys (i) =ys; 
if (t>l) ys=1.0; end 
if (t>7) ys=0.0; end 
■4| (abs(t-(tref+delt))<0.001) 
k=k+l; 

tref=t; u~2.5*(ys-ym); pem_t_data(k)=t; pem_u_data(k)=u; 
pem_y_data(k)=ym; 
end 

for j=l: 1000 u_data (j ) ~u_da t.a (j +1) ; end 
•u_data (10 01) =u; : (i) =u ; 

[x,y]=g_discrete_arxl_PEM(x,sub_delt,u_data,al,a2,bl,b2,delay); 
end 

figure (1) ; plot (tt, yy, tt, uu) ; legend (' y (•_)',' u ( L) ') ; 

% PEM for the ARX model 
msslength (pem_u_data) ; 
for k=l :m-7 

Y(k,1)=pem_y_data(k+7); 
phi_l (k, l)-* s -pem_y_data (k+6) ; 
phi_2 (k,)--pcT._y_dara (k+5) ; 
phi_3(k,1)=pem_u_data(k+1); 
phi_4(k,1)=pem_u_data(k); 
end 

PHI= [phi_l phi_2 phi_3 phi_4 ] ; 

P=inv(PHI'*PHI)*PHI' *Y; 

■yy_m=PHI*P; 

fprintf (' al-%8.7f a2=%8.7f bl=%8.7f b2=%8.7f \n' , P (1) , P (2) , P (3) , P (4) ) ; 
figure(2); plot(tt,yy,' c' ,pem_t_data(8:m),yy_m,'k'); 
legend('process','model'); 

g_d i s c r e t e_a r^c5,^PEM. m 

function, 

[next_x,y]=g_discrete_arxl_PEM(x,sub_dei^;u,al,a2,bl,b2, delay) ; 
sub_subdelt=0.005; n=round(sub_delt/sub_subdelt); 
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Table 10.3 ( Continued ) 

A=[0 ~s.fi 1 -al] ; B=[b2; bl] ; C=[0 1] ; 
delay_k=raund(delay/sub_delt) f' " 
for i=l: n 

dx=A*x+B*u(1000-delay_k) ; 
x=x+dx*sub_subdelt; 
end 

next_x=x; y=C*x; 
re tuft". 

Command Window 
» PEM_arxl 

al=-l.8107394 a2=0.8197907 bl=0.0028756 b2=0.0061637 


Example 10.2.1 Autoregressive Exogenous Input Model for the Case that the Time 
Delay is Unknown 

It is assumed that the bias term B = 0 is known and the time delay of the process is unknown. 
Then, the discrete-time ARX model should be chosen as 

y(kAt) = - aiy((k - l)Af) - a 2 y((k - 2)At) +biu((k-l- d)At) + b 2 u((k - 2 - d)At) 

(10.13) 

The model parameters of the ARX model obtained by the prediction error identification 
method (10.10) are di = - 1.8107394, d 2 = 0.8197907, b x = 0.002 875 6, 
b 2 = 0.006 163 7 and d = 5. The initial interval for the interval-halving method is chosen 
as dmm = 0 and c/ max = 10. The MATLAB code is shown in Table 10.4. It should be noted that 
the variable d is an integer. So, the code rounds off the real number chosen by the interval¬ 
halving algorithm to the closest integer number and it terminates when the interval is 1. 


Table 10.4 MATLAB code to estimate the ARX model using the interval-halving method 
and the least-squares method. 

PEM_arx2.m 

clear; 

delt=0.1; sub_delt«*0.02; tf=15; trefe=^delt+sub_delt; ys=0.0; 
n=round(tf/sub_delt); 

al=2.0; a2=l.0; bl=0.0; b2=1.0; de!ay-0.5; %process 
C=[0 1] ; x-;ft ; 0] ; y=0.0; u_data=zeros(1,1001); u=0.0; 
k=0; rand('seed',0); noise=(rand(1,n)-0.5)*0.0; 
for i=l: n 

■issi*sub_delt; tt (i) Afe;-ym=y+noise (i) ; yy(i)=ym; yys (i) =ys; 
if (t>l) ys=1.0; end 
Si (t>7) ys-C.0; end 
•if (abs(t-(tref+delt))<0.001) 
k=k+l; 

trej^fSf&f tii=2.5* (ys-ym) ; pem_t_data (k) =t; pem_u_data (k) =u; 
pem_y_data(k)=ym; 


(continued) 




324 


Process Identification and PID Control 


Table 10.4 ( Continued ) 

for |M:1000 

u_data(j)=u_data(j+1); 

end 

\l_data (1001)=u; up (i )-u; 

[x,y]=g_discrete_arx2_PEM(x,sub_delt,u_data,al,a2,bl,b2,delay); 
end 

figure (1) ; plot (tt, yy, tt, uu) ; legend (' y (t) ' ,' u (t) ') ; 

% PEM for the ARX model 
% i r. to rva I -ha i vinq method 
dr.ax-10; dmi r.-0; 4 Let—0; 
while (1) 

iter=iter+l ; 
interval=(dmax-dmin)/4; 
dl=r6tind (dminf^fterval) ; 
d2-round (dm i r.+2* i r. :„erva 1) ; 
d3-rcunc (dm i r. + 3* : r. :„erva ! ) ; 

[f1,P]=error_arx2_PEM(pem_u_data,pem_y_data,dl); 

[12,P]=error_arx2_PEM(pem_u_data,pem_y_data,d2); 

[13,P]=error_arx2_PEM(pem_u_data,pem_y_data,d3); 
if ( (fl<f2) & (f2<=f3)) dmax=d2; end 
( (fl>=#2-j & (f2>f3) ) dmin=d2; end 
if((fl>=f2) & (f2<=f3)) dmin=dl; dmax=d3; end 
if(abs(dmax-dmin) =-g$ 

[f1,Pmin]=error_arx2_PEM(pem_u_data,pem_y_data,dmin); 

[f2,Pmax]=error_arx2_PEM(pem_u_data,pem_y_data,dmax); 
if(f2<=fl) d=dmax; P=Pmax; else d=dmin; P=Pmin; end 
break; 

end 

Iprintf (' iter=%2d fl=%8.4e f2=%8.4e f3=%8.4e dl=%2d d2=%2d d3=%2d 
\n',iter,11,f2,f3,dl,d2,d3); 
end 

fprin||||' al=%8.71 a2=%8.7f bl=%8 .If b2=%8.7f d=%3d 
\n',P(l),P(2),P(3),P(4),d); 

error_arx2_PEM.m 

fuiJiSS-lfcS [error, P] =error_arx2_PEM (pem_u_data, pem_y_data, d) ; 
(pem_u_data) ; 

for k=l ;m-2-d 

Y(k,1)=pem_y_da ta(k+d+2); 
phi^l(k,1)=-pem_y_data(k+d+1); 
phi_2 (k, 1)=-pem_y_data(k+d); 
phi_3(k,1)=pem_u_data(k+1); 
phi_4(k,1)=pem_u_data(k); 

PHI= [phi_l phi_2 phi_3 phi_4] ; 

P=inv(PHI'*PHI)*PHI'*Y; 

yy_m=PHI*P; 
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Table 10.4 ( Continued ) 

error=(pem_y_data(d+3:m)-yy_m')*(pem_y_data(d+3:m)-yy_ra* 5'/ 
(ra-d-2) ■; 


g_discrete_arx2_PEM.m 

f ur.ctian 

[next_x, y] =g_discrete_arx2_PEM (x, sub_de44s* jo*41, a2, bl, b2, delay) ; 
sub_subdelt=0 , OSif n=round(sub_delt/sub_subdelt) ; 

A=[0 -a2 ; 1 -al] ; B= [b2 ; bl] ; C=[0 i'll* 
delay_k=round(delay/sub_delt)£ 
for i=l: n 

dx=A*x#fjPu (1000-delay_k) ; 
x=x+dx*sub_subdelt; 

end 


Command Window 


» PEM_arx2 

iter= 1 f1=6.1500e-006 f2=2.5526e-009 f3=l.7149e-005 dl= 3 d2= 5 d3= 8 
iter=;|5;i:i=2.4156e-006 f 2=7.2092e-007 f3=7.9410e-006 dl= 4 d2= 6 d3= 7 
iter= 3 fl=2>^g26e-009 :2-7.2C92e-0C 7 f3=7.2092e-007 dl= 5 d2= 6 d3= 6 
al=-l, 8107394 a2 = 0.81S790.7 bl = 0.0028756 b2=0.0061637 d= 


10.3 Prediction Error Identification Method for the Output Error Model 

The prediction error identification method to identify the OE model estimates the model 
parameters by minimizing the prediction error of the OE model (Ljung, 1987). It solves the 
following optimization problem to obtain the model parameters from the discrete-sampled- 
datay(zAf), i= d + n + 1,.. .,1Vand known u{t). The objective function of (10.14) is the norm 
of the multistep-ahead prediction error: 

1 N 

V(cii, ■ ■ ■ ,a n ,bi, ■ ■ ■ ,b n , d,B) =-. —^ V'' (y(/At) — y(iAt)) 2 

N-d-n 4“ 



subject to 

OE model (10.2) (10.14) 

where y(iAt) and y(iAt) denote the process output and the model output respectively. 

10.3.1 Case 1: Time Delay is Known 

Assume that the time delay dAt is known. Then, the optimization problem (10.14) becomes the 
following form: 
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V(a u ---,a„,b u ---,b n ,B)=—^ - ^ {y{iAi)-y{iAt)f 

N — d — n i=d+n+x 

subject to 

OE model 10.2 (10.15) 

To solve this optimization problem, the following Levenberg-Marquardt method is used, 
which repeats (10.16) until the parameters converge within tolerance: 



P(j) =P(j~ 1 )- 


[~9 2 v’(p(/— i)) , ,~| -1 favoc/-1))~| 


w 


Y e P 


(10.16) 


P=[a i ci2 ■■■ a„ b\ l>2 b„ d fi] T 


(10.17) 


where j denotes the iteration number and a is a small positive value that can be updated 
every iteration to compromise between the robustness and the convergence rate. For details, 
refer to Chapter 2. The initial values in (10.16) are recommended to be chosen as the model 
parameters obtained by the prediction error identification methods for the ARX model of 
Section 10.2. 

The partial derivatives of the objective function with respect to the adjustable parameters 
in (10.16) can be calculated by using the numerical derivative or solving the difference 
equations. Refer to Chapter 2 for the numerical derivative. Refer to the following to understand 
how to calculate the partial derivatives by solving the difference equations. 

From (10.15), (10.18) is derived: 


8 V(p) 
dp 


N-d- 


t 




(10.18) 


8K0 = ... ... 95KO ^X01 T (1019) 

8 p [ 8«i da n Qbi db„ dB \ 

From (10.2), the partial derivatives (10.20)-(10.24) are obtained for d\, a.2, b\, S2 and B. 
Also, the other partial derivatives can be derived in a similar way. Then, the partial derivatives 
in (10.18) can be calculated by solving the difference equations. 

dy(kAt) A „ u ft 0y((*-l)Af) 0y((fc-2)At) , dy({k-n)At) 

~dbT = — 0 --— Wi -^— 

( 10 . 20 ) 

dy{kAt) &ttu ^ ,dy((k~ 1)A0 , 8y((£-2)At) , dy{{k~n)At) 

-ddT = -^-2)At)-«l -g^--g^--Qfc- 

( 10 . 21 ) 
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0*1 0*1 0*1 0*1 

( 10 . 22 ) 

.giM.) _ .^^40 _ Jgg -Mx_ 

0*2 0*2 0*2 0*2 

(10.23) 

0v(A-AO , 0y((fc-l)A$ „ dy((k—2)At) a 0y((fc-*)Af) it /in _ 

-X = —fll-—;- «2 -—:- •••—an -—:-1-1 (10.24) 

05 06 06 06 

The initial values of all the partial derivatives are zero because the parameter of p does not affect 
the initial values of the partial derivatives. 

The second derivative of (10.16) is 


■ #(p) 

0# 



{y(iAt) -y(iAt)) 


d 2 y(iAt) 

bp 2 



(10.25) 


When the solution is close to actuality, the first term of the right-hand side in (10.25) can be 
neglected: 


Q2 v(p) 1 y' 

by(iAt) 

dy(iAt) 

dp 2 N-d-n. , 

r i=d+n+1 

. . 

. . 


(10.26) 


In summary, all the partial derivatives in (10.18) and (10.26) are calculated for a given 
p(j — 1) by selecting them at every sampling while continuously solving the difference 
equations such as (10.2) and (10.20)-(10.24) simultaneously. Next, it is straightforward to 
calculate the updated parameters p(j) from (10.16). Repeat this procedure until the parameters 
converge. 


10.3.2 Case 2: Time Delay is Unknown 

Assume that the time delay dAt is unknown. Then, the optimization problem (10.14) should be 
solved. The optimization problem (10.14) can be rewritten (10.27) using the optimal solution 
of Case 1: 


min \ v{d) = —— - ]T {y(iAt) —y(iAt))‘ 

N-d-n 


subject to solutions of (10.15) 


(10.27) 
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To solve the optimization problem, the interval-halving method can be used because (10.27) 
is a one-dimensional nonlinear optimization problem. In this case, it should be noted that d is an 
integer. So, the real number chosen by the interval-halving algorithm should be converted to the 
closest integer number for every iteration and the termination condition should be changed. For 
the detailed code to reflect this, refer to the Example 10.3. 


Example 10.3 

Estimate the OE model for the activated process input and the process output in 
Example 10.2. 


Solution Two cases are considered. The first case assumes that the time delay is known. The 
second case assumes that the time delay is unknown. 


Example 10.3.1 Output Error Model for the Case that the 
Time Delay is Known 

It is assumed that the time delay of the process is 0.5, as shown in (10.11). So, the number of the 
sampling time corresponding to the time delay is 5. Also, the order of the process is 2 and it is 
assumed that the bias term B = 0 is known. Then, the discrete-time OE model should be 
chosen as 


y(kAt) = — d\y((k — l)At) — a 2 y((k — 2) At) + b\u{{k — 6)A t) + b 2 u((k — l)At) (10.28) 


The model parameters of the OE model obtained by the prediction error identification 
method of (10.15) are Si = - 1.8142, d 2 = 0.823 05, b t = 0.004443 and b 2 = 0.004425 1. 
The initial values for the Levenberg-Marquardt method are chosen as Si = — 1.5, d 2 = 0.60, 
b\ = 0.002 and b 2 = 0.003. The MATLAB code is shown in Table 10.5. 


Example 10.3.2 Output Error Model for the Case that the 
Time Delay is Unknown 

It is assumed that the time delay of the process is unknown and the bias term B = 0 is known. 
Then, the discrete-time OE model should be chosen as 


y(kAt) = - a\y((k - l)Af) - a 2 y((k - 2)At) + biu((k - 1 - d)At) + b 2 u((k - 2 - d)At) 

(10.29) 


The model parameters of the OE model obtained by the prediction error identification 
method of (10.27) are ai = - 1.8142, a 2 = 0.823 05, b x = 0.004 443 b 2 = 0.004 425 1 and 
d = 5. The initial values for the Levenberg-Marquardt method are chosen as Si = — 1.5, 
a 2 = 0.60, b\ = 0.002 and b 2 = 0.003. And the initial interval for the interval-halving 
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Table 10.5 MATLAB code to estimate the OE model using the Levenberg-Marquardt method. 

PEM_oel.® 

clear; 

delt=0.1; sub_delt=0.01; tf=15; tre£=^delt+sub_delt; ys=0.0; 
n=round(tf/sub_delt); 

fete-2.0; a2=l.0; bl»0.0; b2=1.0; delay=0.5; %process 
C=[0 1] ; x=[0 0] ; y=0.0; u_data=zeros (1, 1001) ; u=0.0; 

k=0; rand('seed' ,0) ; noise=(rand(1,n)-0.5)*0.0; 
for i=l: n 

t==i*sub_delt; tt ( ; ) —t; ym-y+r.c ; se ( ; ' ; yy(i)=ym; yys(i)=ys; 

$$ (t>l) ys=1.0; end 
If (t>7) ys-C.0; end 
if (abs(t-(tref+delt))<0.001) 
k=k+l; 

tref=t; u=2.5*(ys-ym); pem_t_data(k)=t; pem_u_data(k)=u; 
pem_y_data(k)=ym; 
end 

for j—1:1000 
u_data (j ) -ni_data (j+1) ; 
end 

u_data(1001)=u; uu(i)=u; 

[x,y]=g_discrete_oel_PEM(x,sub_delts^S|_.data,al,a2,bl,b2,delay); 
end 

figure (1) ; plot (tt, yy, tt,uu) ; legend (' y (t) ',' U (t )') ; 

% PEM for the OE model 

al=-l. 5; a2=0.6; bl=0.002; b2=0.003; %initial values for the LV method 
[P,E]=lv_oel(pem_u_data,pem_y_data,al,a2,bl,b2,5)| 
fprin)S||' al=%8.4e a2=%8.4e bl=%8.4e b2=%8.4e d=%2d E=%8.4e 
\n',P(1),P(2),P(3),P(4),5,E); 

lv_oel.m 

functifeji [P, E_new]=lv_oel(pem_u_data,pem_y_data,al,a2,bl,b2,d) 
delta=0.00001; % ; nrerva'L. for the numerical derivatives 
alpha=1.0; index_update=l; iter=0; 

Pb= [al a2 bl b2 ] ' ; 

E=object_PEM_oel(pem_u_data,pem_y_data,al,a2,bl,b2,d); 
ifprlntf (' iter=%2d al=%8.4e a2=%8.4e bl=%8.4e b2=%8.4e d=%2d 
E=%8.4e\n' , iter, Pb (1) , Pb (2) , Pb (3) , Pb (4) , d, E) ; 
while (1) 

if (index_update==l) 

al=Pb(1); a2=Pb(2) ; bl=Pb(3); b2=Pb(4); 

E=object_PEM_oel(pem_u_data,pem_y_data,al,a2,bl,b2, d); %object 
fuhctlcn 

E_al=object_PEM_oel(pem_u_data,pem_y_data,al+delta,a2,bl,b2,d) 
E_a2=object_PEM_oel(pem_u_data,pem_y_data,al,a2+delta,bl,b2,d) 
E_bl=object_PEM_oel(pem_u_data,pem_y_data,al,a2,bl+delta,b2,d) 
E_b2=object_PEM_oel(pem_u_data,pem_y_data,al,a2,bl,b2+delta,d) 
E_al_al=object_PEM_oel(pem_u_data,pem_y_data,al+2*delta,a2,bl,b2,d) 
E_a2_a2=object_PEM_oel(pem_u_data,pem_y_data,al,a2+2*delta,bl,b2,d) 
E_bl_bl=object_PEM_oel(pem_u_data,pem_y_data,al,a2,bl+2*delta,b2,d) 


( continued ) 
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Table 10.5 ( Continued ) 

E_b2_b2=object_PEM_oel(pem_u_data,pem_y_data,al,a2,bl,b2+2*delta, d); 
E_al_a2=object_PEM_oel(pem_u_data,pem_y_data,al+delta, 
a2+delta,bl,b2,d); 

E_al_bl=object_PEM_oel(pem_u_data,pem_y_data,al+delta,a2, 
bl+delta,b2,d); 

E_al_b2=object_PEM_oel (pem_u_data, pem_y_data, a'. +de Lta, a2, bl, 
b2+delta,d); 

E_a2_bl=object_PEM_oel(pem_u_data,pem_y_data,al,a2+delta, 
bl+delta,b2,d); 

E_a2_b2=object_PEM_oel(pem_u_data,pem_y_data,al,a2+delta, bl, 
b2+delta,d); 

E_bl_b2=object_PEM_oel(pem_u_data,pem_y_data,al,a2,bl+delta, 
b2+delta,d); 

dV(l,l)=(E_al-E)/delta; %dV/dpl 
dV(2,l)=(E_a2-E)/delta; %dV/dp2 
dV(3,l)=(E_bl-E)/delta; %dV/dp3 

dV(4,1)=(E_b2-E)/delta; %dV/dp4* 

ddV(1,1)=(E_al_al-2*E_al+E)/delta A 2; %d A 2V/dpl A 2 
ddV(2,2)=(E_a2_a2-2*E_a2+E)/delta A 2; 
ddV(3,3)=(E_bl_bl-2*E_bl+E)/delta A 2; 
ddV(4,4)=(E_b2_b2-2*E_b2+E)/delta A 2; 

ddV (1,2) = (E^a:l_a2-E_al-E_a2+E) /delta A 2; %d A 2V/dpldp2 
ddV(1,3)=(E_al_bl-E_al-E_bl+E)/delta A 2; 
ddV(1,4)=(E_al_b2-E_al-E_b2+E)/delta A 2; 

ddV(2,3)-(E_a2_bl-E_a 2-E_b1+E)/de11a A 2; 
ddV(2,4)=(E_a2_b2-E_a2-E_b2+E)/delta A 2; 

ddV(3,4)=(E_bl_b2-E_bl-E_b2+E)/delta A 2; 

ddV(2,1)=ddV(1,2); ddV(3,1)=ddV(1,3); ddV(4,1)=ddV(1,4); 
ddV(3,2)=ddV(2,3); ddV(4,2)=ddV(2,4) ; 
ddV(4,3)=ddV(3,4) ; 
end 

P=Pb-inv(ddV+alpha*eye(4))*dV; 
al=P(1); a2=P(2); bl=P(3); b2=P(4); 

[E_new yy_m] =(S3biject_PEM_oel (pem_u_data, pem_y_data, al, a2, bl, b2, d) ; 
';|E_new<E) 
index_update=l; 
alpha=alpha/2.0; Pb=P; 
iter=iter+l; 

fprintf (' iter=%2d al^.3e a2=^.3e bl=%S.3e b2=%5.3e d=%2d 
E=%5.3e\n',iter,P(l),P(2),P(3),P(4),d,E); 
else 

index_update=0; 
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Table 10.5 ( Continued ) 
alpha=alpha*l.5 ; 

if (iter==25 I alpha>10.0 A 10) break; end 
end 

object_PEM_oel.m 

function [V yy_m]=object_PEM_oel(uu,yy,al,a2,bl,b2,d) 
n=length (uu); 

for fail: (d+2) yy_m (i) =yy (i) ; end %,iffcif.ial values 
for |^d+3) : n 

yy_m(i)=-al*yy_m(i-1)-a2*yy_m(i-2)+bl*uu(i-l-d)+b2*uu(i-2-d) ; 
v=(yy-yy_m)*(yy-yy_m)'/(n-d-2); 

g_discrete_oel_PEM.m 

function [next_x,y]=g_discrete_oel_PEM(x,sub_delt,u,al,a2,bl,b2, 
delay); 

sub_subdelt=0.005; n=round(sub_delt/sub_subdelt); 

A= [0 -a2 ; 1 -al] ; B= [b2 ; bl] ; C=[0 1] ; 
delay_k=round(delay/sub_delt); 
for i=l: n 

dx=A*x+B*u(1000-delay_k); 
x=x+dx*sub_subdelt; 

end 

next_x=x; y=C*x; 


object_PEM_oel .n|', , 

function [V yy_m]=object_PEM_oel(uu,yy,al,a2,bl,b2,d) 
n=length(uu); 

for i=l: (d+2) yy_m (i) =yy (i) ; end %initial values 
for fa|d+3) : n 

yy_mCj.'jfa-al*yy_m^pl) -a2*yy_m : (i»2:) +bfa'ilp|fat-d) +b2N^(i-2-d) ; 
end 

v=(yy-yy_m)*(yy-yy_m)*/(n-d-2); 

g_discrete_oel_PEM.#' 

function [next_x,y]=g_discrete_oel_PEM(x,sub_delt,u,al,a2,bl,b2, 
delay); 

sub_subdelt=0.005; n=round(sub_delt/sub_subdelt); 

A= [0 -a2 ; 1 -al] ; B= [b2 ; bl] ; C=[0 1] ; 
delay_k=round(delay/sub_delt); 
for i=l: n 

dx=A*x+B*u(1000-delay_k); 
x=x+dx*sub_subdelt; 

end 

next_x=x; y=C*x; 
return 


(i continued ) 
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Table 10.5 ( Continued ) 

Command Window 

» PEM_oel 

iter= 1 al=-1.497e+000 a2=6.663e-00l bl=-7.420e-002 b2-7.6b3e-C02 d= 5 
E=2.583e-001 

iter= 2 al=-l. 526e+000 a2 = 6.341e-001 bl=-6.690e-002 b2=9.7b7e-002 d- | 
E=2.449e-001 iter=19 al=-l.814e+000 a2=8,231e-001 bl=4.457e-003 
b2 = 4.408e-003 d= 5 E=1.179e-0Q5 

iter=20 al=-l. 814e+000 a2=8.230e-001 bl=4 .443e-003 b2=4.425e-003 d= 5 
E=6.7 04e-006 al=-l.8142e+000 a2=8.2305e-001 bl=4.4433e-003 b2=4.42Sle- 
003 d= 5 E=6.5084e-006 


method is d mm — 0 and d mm = 10. The MATLAB code is shown in Table 10.6. It should be 
noted that the variable d is an integer. So, the code rounds off the real number chosen by 
the interval-halving algorithm to the closest integer number and it terminates when the 
interval is 1. 


Table 10.6 MATLAB code to estimate the OE model using the interval-halving method and the 
Levenberg-Marquardt method. 

PEM_oe2.m 

delt=0.1; sub_ce I L-0 . O'. ; tf=15; tref=-delt+sub_delt; ys=0.0; n=round 
(tf/sub_delt ); 

al=2.0; a2=l.0; bl=0.0; b2=1.0; delay=0.5; %process 
C=[0 1]; x= [0 ; 0] ; y=0.0; u_data=zeros(1,1001) ; u=0.0; 
k=0; rand ('seed', 0) ; noise= (rand (1, n)0.0; 
for i=l: n 

t=i*sub_delt; |%;:(i)=t; ym=y+noise (i) ; yy(i)=ym; yys(i)=ys; 
jjj|$ (t>l) ys=1.0; end 
(t>7) ys=0.0; end 
if (abs(t-(tref+delt))<0.001) 
k=k+l; 

tref=t; u=2.5* (ys-ym) ; pem_t_data (k) =t; pem_u_data (k)'»|j| ; 
pem_y_data(k)=ym; 
end 

for >-l: 1 COO 

u_data(j)=u_data(j+1); 
end 

u_data(1001)=u; uu(i)=u; 

[x,y]=g_discrete_oe2_PEM(x,sub_de3£%$if_data,al,a2,bl,b2,delay); 

end 

figure (1) ; pj^pfs(tt, yy, tt,uu) ; legend (' y (t) ' , ' u (t) ' ) ; 

% PEM for the OE model 
% interval-halving method 
dmax=10; dmin=0; iter=0; 

al=-l .5; a2=0.6; bl=0.002; b2=0.003; %initif'al values for the LV method 
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Table 10.6 ( Continued ) 

while (1) 

iter=iter+l ; 
interval=(dmax-dmin)/4; 
dl=round (dminfflilterval) ; 
d2=round(dmin+2*interval) ; 
d3=round(dmin+3*interval); 

[P,f1]=lv_oe2(pem_u_data,pem_y_data,al,a2,bl,b2,dl); 

[P,f2]=lv_oe2(pem_u_data,pem_y_data,al,a2,bl,b2,d2); 

[P,f3]=lv_oe2(pem_u_data,pem_y_data,al,a2,bl,b2, d3) ; 
if((fl<f2) & (f2<=f3)) dmax=d2; end 
4|((fl>=f2) & (f2>f3)) dmin=d2; end 

f (fl>=£2) & (f2<=£3) ) dntin=dl; dmax=d3; end 
if (abs (dmax-dmin,I’r=fTy 

[Pmin,f1]=lv_oe2(pem_u_data,pem_y_data,al,a2,bl,b2,dmin); 
[Pmax,f2]=lv_oe2(pem_u_data,pem_y_data,al,a2,bl,b2,dmax); 
iif(f2<=fl) d=dmax; P=Pmax; else d=dm%jj'^ 1 P=Pmin; end 
break; 

end 

fprintf (' iter=%2d fl=%8.4e f2=%8.4e f3=%8.4e dl=%2d d2=%2d d3=%2d 
\n' , iter, f1, f2,f3,dl,d2,d3); 

fprintf (' al=%8.7 #b; 2=%8.7f bl=%8.7f b2=%8.7f d=%2d 
\n' , P(l) , ?(2),P(3),P (4), d) ; 

lv_oe2 .ni. 

ffttO0;ion [P,E_new]=lv_oe2(pem_u_data,pem_y_data,al,a2,bl,b2,d) 
delta-D, 00001; %interval for the numerical derivatives 
alpha^KfcO;index_update=l;iter=0; 

Pb= [al a2 bl b2 ] ' ; 

E=object_PEM_oe2(pem_u_dat&.,pem_y_data,al,a2,bl,b2,d); 

% fprintf (' iter=%2d al=%8.4e a2=%8.4e bl=%8.4e b2=%8.4e d-%2d 
E=%8.4e\n , ,iter,Pb(l),Pb (2) ,Pb(3),Pb(4),d,E); 

while (1) 

if (index_update==l) 

al=Pb(1); a2=Pb(2); bl=Pb(3); b2=Pb(4); 

E=object_PEM_oe2(pem_u_data,pem_y_data,al,a2,bl,b2,d); %object 
.function 

E_al=object_PEM_oe2(pem_u_data,pem_y_data,al+delta,a2,bl,b2,d) 
E_a2=object_PEM_oe2(pem_u_data,pem_y_data,al,a2+delta,bl,b2,d) 
E_bl=object_PEM_oe2(pem_u_data,pem_y_data,al,a2,bl+delta,b2,d) 
E_b2=object_PEM_oe2(pem_u_data,pem_y_data,al,a2,bl,b2+delta,d) 

E_al_al=obj ect_PEM_oe2(pem_u_data,pem_y_data,al+2*delta,a2,bl,b2,d) 
E_a2_a2=obj ect_PEM_oe2(pem_u^data,pem_y_data,al,a2+2 *delta,bl,b2,d) 
E_bl_bl=object_PEM_oe2(pem_u_data,pem_y_data,al,a2,bl+2*delta,b2,d) 
E_b2_b2=object_PEM_oe2(pem_u_data,pem_y_data,al,a2,bl,b2+2*delta,d) 
E_al_a2=object_PEM_oe2(pem_u_data,pem_y_data,al+delta,a2+delta,bl, 
b2,d); 


{continued ) 
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Table 10.6 ( Continued ) 

E_al_bl=object_PEM_oe2(pem_u_data,pem_y_data,al+delia, a2, bl+delta, 
b2,d) ; 

E_al_b2=object_PEM_oe2(pem_u_data,pem_y_data,al+delta,a2,bl,b2+ 
delta,d); 

E_a2_bl=object_PEM_oe2(pem_u_data,pem_y_data,al, a2+delta,bl+delta, 
b2,d); 

E_a2_b2=object_PEM_oe2(pem_u_data,pem_y_data,al,a2+delta,bl,b2+ 
delta,d); 

E_bl_b2=object_PEM_oe2(pem_u_data,pem_y_data,al,a2,bl+delta,b2+ 
delta,d); 

dV(l,l)=(E_al-E)/delta; %dV/dpl 
dV(2,l)=(E_a2-E)/delta; %dV/dp2 
dV(3,l)=(E_bl-E)/delta; %dV/dp3 
dV(4,l)=(E_b2-E)/delta; %dV/dp4 

ddV(1,1)=(E_a;_al-2*E_a:+E)/del't_a A 2; %d A 2V/dpl A 2 
ddV(2,2)=(E_a2_a2-2*E_a2+E)/delta A 2; 
ddV(3,3) = (E_bl_b1-2* E_b1+E)/deita A 2; 
ddV(4,4)=(E_b2_b2-2*E_b2+E)/delta A 2; 

ddV(1,2)=(E_al_a2-E_al-E_a2+E)/delta A 2; %d A 2V/dpldp2 
ddV(1,3)=(E_al_bl-E_al-E_bl+E)/delta A 2; 
ddV(1,4)=(E_al_b2-E_al-E_b2+E)/delta A 2; 

ddV(2,3)=(E_a2_bl-E_a2-E_bl+E)/delta A 2; 
ddV(2,4)=(E_a2_b2-E_a2-E_b2+E)/delta A 2; 

ddV(3,4)=(E_bl_b2-E_bl-E_b2+E)/delta A 2; 

ddV (2,1) =ddV (1,2) ; ddV (3,1) =ddV (1,3) ; ddV (4, ", )-dcV (1 > 4) ; 
ddV(3,2)=ddV(2,3) ; ddV(4,2)=ddV(2,4) ; 
ddV(4,3)=ddV(3,4) ; 

P=Pb-inv(ddV+alpha*eye(4))*dV; 
al=P(1); a2=P(2); bl=P(3); b2=P(4); 

[E_new yy_m]=object_PEM_oe2(pem_u_data,pem_y_data,al,a2,bl,b2,d); 
if (E_new<E) 

index_update=l; 
alpha=alpha/2.0; Pb=P; 
iter=iter+l? i 

1 %bin-tf'| i 'tte£^%2d al=%5.3e a2=%5.3e bl=%5.3e b2=%5.3e d=%2d 
E=%5.3e\n',iter,P(l),P {2) ,P(3),P(4),d,E); 

index_update=0; 
alpha=alpha*l.5; 

end 

; ;$i.f (iter==25 | alpha>10.0 A 10) break; end 
end 
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Table 10.6 ( Continued ) 

obj ect_PEM_oe2.m 

function [V yy_m] -ob';ect_PEM_oe2 (uu, yy, al, a2, bl, b2, d) 
n=length(uu); 

’top i=l: (d+2) yy_m (i) =yy (i) ; end values 

for i= (d+3) :n 

yy_m(i)=-al*yy_m(i-1) -a2*yy_m (fell) +bl*uu (iw|-^d) +b2f$4(i-2-d) ; 
end 

v=(yy-yy_m)*(yy-yy_m)'/(n-d-2); 


g_discrete_oe2_PEM.m 

function [next_x, y]=g_discrete_oe2_PEM(x, 
sub_delt,u,al,a2,bl,b2,delay); 

sub_subdelt=0.005; n=round(sub_delt/sub_subdelt); 
A= [0 -a2 ; 1 -al] ; B= [b2 ; bl] ; C=[0 1] ; 
delay_k=round(delay/sub_delt)f 
for i=l: n 

dx=A*x+B*u(1000-delay_k); 
x=x+dx*sub_subdelt; 

end 

next_x=x; y=C*x; 


g_d.iscrete_oe2_PEM.rn 

function [next_x,y]=g_discrete_oe2_PEM(x,sub_delt,u,al,a2,bl,b2, 
delay); 

sub_subdelt=0,005; n=round(sub_delt/sub_subdelt); 

A= [0 -a2 ; 1 -al] ; B= [b2 ; bl] ; C=[0 1] ; 
delay_k=round (delay/sub_delt) if 
,|or i=l: n 

dx=A*x+B*u(1000-delay_k); 
x=x+dx*sub_subdelt; 

end 

next_x=x; y=C*x; 
return 


Command Window 

» PEM_oe2 

iter= 1 f1=3.4413e-005 f2=6.5084e-006 f3=2.7655e-004 dl= 3 d2= 5 d3= 8 
iter= 2 fl=7.4870e-006 f2=l. 2640e-005 f3=5.0833e-005 dl= 4 d2= 6 d3= 7 
al=-l. 8141750 a2 = 0.8230493 bl = 0.0044433 b2=0.0044251 d= §''' 


10.4 Concluding Remarks 

The ARX model predicts a one-step-ahead process output and the OE model predicts a 
multistep-ahead process output. So, the prediction error identification method for the ARX 
model estimates the model parameters by minimizing the one-step-ahead prediction errors. 
Meanwhile, the prediction error identification method for the OE model estimates the model 
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parameters by minimizing the multistep-ahead prediction errors. In most cases, the process 
model should have a good capability of multistep-ahead prediction. So, the OE model is usually 
preferred to the ARX model. But the prediction error identification method for the OE model 
requires solving a complicated multidimensional nonlinear optimization problem to obtain the 
model parameters, whereas the prediction error identification method for the ARX model 
obtains the model parameters in a very simple way using the least-squares method. The initial 
values for the nonlinear optimization method in the prediction error identification method for 
the OE model are recommended to be chosen as the model parameters obtained by the 
prediction error identification method for the ARX model. 


Problems 

10.1 Activate the following process using the biased-relay with a sampling time of 0.2 and 
estimate the ARX model with a known time delay. Compare the model output and the 
process output. In this case, calculate the model output using the OE model for which the 
coefficients are those of the ARX model. 


d 3 y(f) d 2 y{t) 

dP d f 


10.2 Estimate the ARX model with an unknown time delay for the activate process data of 
Problem 10.1 and compare the model output and the process output. In this case, assume 
that the ARX model is an SOPTD model. Also, calculate the model output using the OE 
model for which the coefficients are those of the ARX model. 

10.3 Estimate the OE model with a known time delay for the activated process data of 
Problem 10.1 and compare the model output and the process output. In this case, 
determine the initial estimates using the prediction error method for an ARX model. 

10.4 Estimate the OE model with the unknown time delay for the activated process data of 
Problem 10.1 and compare the model output and the process output. In this case, 
determine the initial estimates using the prediction error method for an ARX model. 

10.5 Activate the virtual process of Process 3 (refer to the Appendix for details) using a biased- 
relay and estimate the ARX model with an unknown time delay. Compare the model 
output and the process output. In this case, calculate the model output using an OE model 
for which the coefficients are those of the ARX model. 

10.6 Activate the virtual process of Process 3 (refer to the Appendix for details) using a biased- 
relay and estimate the OE model with an unknown time delay. Compare the model output 
and the process output. 


Reference 

Ljung, L. (1987) System Identification , Prentice-Hall, Englewood Cliffs, NJ. 



11 


Model Conversion from 
Discrete-Time to Continuous-Time 
Linear Models 


11.1 Transfer Function of Discrete-Time Processes 

In Part One, the Laplace transform was used to derive the transfer function of a continuous-time 
process. For a discrete-time process, the z-tranform is used. Consider the following discrete¬ 
time process: 

y(kAt) = - a\y{{k - l)Af) - a 2 y{{k - 2)At) - • • • - a n y((k - n)At) 

+ biu((k - 1 - d)At) + b 2 u((k - 2 - d)At) + • • • + b„u((k-n- d)At) 

( 11 . 1 ) 


The z-transform of y(kAt) is defined as 

y(z) =Z{y(kAt)} = J2y(kAt)z~ k =y(0At)+y(lAt)z- 1 +y(2At)z~ 2 + ••• (11.2) 


One of the notable properties of the z-transform is y(z)z 1 = Z{y(k — 1 )At)} if y(kAt) = 0, 
k< 0. The property is derived straightforwardly by comparing (11.2) with (11.3): 

Z{y((k-l)At)}=y(-lAt)+y{0At)z- 1 +y(lAt)z- 2 +y(2At)z- 3 + ■■■ (11.3) 

From (11.2) and (11.3), it is clear that y{z)z~ x = Z{y(k - \)At)} if y(kAt) = 0, k< 0. 
Equivalently, y(z)z~ d = Z{y(k — d)At)} if y(kAt) = 0, k<0. Then, (11.4) is obtained by 
applying the z-transform to (11.1): 

y(z)= — aiy(z)z~ 1 — a 2 y(z)z~ 2 — ■■■ -a„y(z)z~ n + b 1 u(z)z~ 1 ~ d (11.4) 

+ b 2 u(z)z~ 2 ~ d + ■■■ +b n u(z)z~ n ~ d 
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Rearranging (11.4), the following transfer function for the discrete-time process is obtained: 


G(z) = 


u(z) 


b l z- l +b 2 z~ 2 + ■■■ +b n z-\_ d 
1 +aiz~ l + ■ ■ ■ +a„z~ n 


(11.5) 


or 


_y(z) _b\z n 1 +b 2 z n 2 +---+b„^_ d 
u(z) z n + aiz n ~ l + ■ ■ ■+a„ 


( 11 . 6 ) 


11.2 Frequency Responses of Discrete-Time Processes 
and Model Conversion 

The frequency response of the process can be obtained directly from the transfer function 
without simulation or plant test. Assume that G(z ) of the transfer function of the process is 
available. Then, the amplitude ratio and the phase angle at the frequency w can be estimated by 
setting z = exp(iwAt) as shown in (11.7) and (11.8): 

AR(tn) = |G(exp(koA?))| = Re(G(exp(icuAf))) 2 + Im(G(exp(iwAf))) 2 (11.7) 

<£(w) = ZG(exp(iwAf)) = arctan of Re(G(exp(i«Ai))) and Im(G(exp(i«Af))) (11.8) 

If the sampling time is small, then the frequency responses in the discrete-time model are 
almost the same as those of the continuous-time model. Then, the frequency responses of the 
continuous-time transfer function can be estimated approximately by estimating the frequency 
responses of (11.7) and (11.8). Then, the discrete-time model can be converted to the 
corresponding continuous-time model by applying the model reduction techniques mentioned 
in Chapter 5. 

Assume that there is a discrete-time transfer function G(z) and it is required to convert it to a 
continuous-time SOPTD model: 


G(z) 


A:exp(— Os) 


(11.9) 


The frequency response of the discrete-time model is used. The model reduction method first 
estimates the gain of the continuous-time model to fit the zero frequency-response data as 
follows: 


k = G(z) U xp(i0A , )= i (11.10) 

and it estimates r and £ to satisfy the equality of (11.11) by solving (11.12) using the 
least-squares method. Equation ( 11 . 12 ) is derived from ( 11 . 11 ) in a straightforward manner: 

A:exp(— i Ow) k 

| 1 - TW + i2l ^ | ^ _ t2w2) 2 + {2xCw f 


|G(exp(iw,At))| 


( 11 . 11 ) 



Model Conversion from Discrete-Time to Continuous-Time Linear Models 


339 


T 4 |G(exp(ko,Af))| 2 <u 4 + (4 t 2 £ 2 — 2T 2 )|G(exp(ku I Af))| 2 cu 2 = k 2 — |G(exp(ko,Af))| 2 

( 11 . 12 ) 

0<tui <tu 2 < • • • <o)j< ■ ■ ■ <(o n (11.13) 

where it is recommended to choose o) n as the ultimate frequency cu u of the discrete-time transfer 
function. If w u is not available, then it should be chosen as the closest one to w u . The model 
reduction method finally estimates the time delay of the continuous-time SOPTD model from 
the phase-angle equation (11.14) with respect to w m . Equation (11.15) is obtained directly 
from (11.14): 

</>((o m ) = — 6(o m + arctan2(— 2£cu m r, 1 — (o 2 m x 2 ) 

- 4>(co w ) + arctan2(— 2grm„„ 1 - tu 2 ,! 2 ) 


where </>(w m ) is the phase angle of G(z) at co m . co m should be oj,„ < a> u . It is recommended to 
choose w m as a frequency close to the ultimate frequency w u of the process. If oj„, = a> u is 
chosen, then (11.14) and (11.15) become the following equations: 

— Jt = — 9w a + arctan2(— 2^w u r, 1 — w 2 t 2 ) 

n + arctan2(— 2^im u , 1 — m^r 2 ) 


In summary, the continuous-time SOPTD model (11.9) can be estimated from (11.10), (11.12), 
and (11.15). 

Similarly, (11.18)—(11.20) can be derived to convert the discrete-time model to the 
continuous-time FOPTD model: 


(11.16) 

(11.17) 


(11.14) 

(11.15) 


k — G(z)|. =exp ( i0A ^ =1 

(11.18) 

^k 2 - |G(exp(iw,„At))| 2 

(11.19) 

G(exp(iw m At)) | (o m 

— <}>((o m ) + arctan( — tw,„) 

6 = 

(11.20) 


Example 11.1 

Obtain the transfer function of the discrete-time OE model obtained in Example 10.3 in 
Chapter 10. 

Solution The discrete-time model obtained in Chapter 10 is 

y(kAt) = - aiy((k- l)At) - a 2 y{{k - 2)At) +biu((k-l- d)At) + b 2 u((k - 2 - d)At) 

( 11 . 21 ) 
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Table 11.1 MATLAB code for the model conversion in Example 11.2. 


g_discrete_ex2.m 


w=0.0; delta_w=0.05; 
delt=0.1; %sampling 

while (1) % search boundary its which wu 
w=w+delta_w; 

g=g_discrete_ex2(w,delt); 

if(imag(g)>0.0) break; end 
end 

wl=w-delta_w; w2=w; % w 1< wu < w2 
while (1) % find wu using the bisection 
method 

w=(wl+w2>/2; 

gl=g_discrete_ex2(wl,delt); 
g=g_discrete_ex2(w,delt). 

if(imag(g)*imag(gl)>0.0) wl=w; else 
w2=w; end 

if (abs(imag(g))<0.000001) break; end 
end 

wu=w; % ultimate frequency wu is found 
k=abs(g_discrete_ex2(0.0,delt)); 
for j=l: 10 % least square method 
w=(j — 1)*wu/9.0; 

G(j)=g_discrete_ex2(w,delt); 
y(j,l)=k-(abs(G(j)) A 2); 
phi_l(j,1)=(abs(G(j)) A 2)*w A 4; 
phi_2(j,1)=(abs(G(j)) A 2)*w A 2; 
end % P_hat: solution of the least square 
method 

PHI=[phi_lphi_2]; Y=y; 

P_hat=inv(PHI'*PHI)*PHI' *Y; 
tau=P_hat(1) A (1.0/4.0); 
xi=((P_hat(2)+2*tau A 2)/ 

(4*tau A 2)) A 0.S> 

theta=(pi+atan2(-2*xi*tau*wu, 1- 
wu A 2*tau A 2))/wu; 

% tau: time contant, xi: damping factor, 

theta: t||Jft ; delay 

fppi-^i' k=%5.3f tau=%5.3f \n', 


function 

[G]=g_discrete_ex2(w,delt) 
z=exp(i*w*delt); 

G=z A (-5)*(0.004443*z A (-1) 

+ 0.0044251*z A (-2))/(1- 

1.8142*z A (-1)+0.82305*z A (-2)); 

end 


Command Window 
» conversion_d2c_ex2 
k=l. 002 tau=l.014 xi=0.984 
theta=0.551 


fprintf (' xi:=%5.3f theta=%5.3f 
\n',xi,theta); 
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Table 11.2 MATLAB code for the model conversion in 

Example 11.3. 

conversion_d2c_ex3.m 

g_discrete_ex3.m 

clear; 

function 

w=0.0 ; delta_w=0.05; 

[G]=g_discrete_ex3(w,delt) 

delt=0.1; %sampling time 

z=exp(i*w*delt) ; 

while (1) % search boundary ih which wu 

G=z A (-5) * (O.OOlllS^-ih'll 

exists 

+ 0.004 42ST*z A (-2)) fcf&rl. 

w=w+delta_w; 

8142*z A ^fe+0.82305*z A (-2) ) ; 

g=g_discrete_ex3(w,delt); 

'If (iinag (g) >0.0) break; end 
end 

wl=w-delta_w; w2=w; % w 1< wu < w2 
while (1) % find wu using the bisection 
method 

w=(wl+w2)/2; 

gl=g_discrete_ex3(wl,delt) ; 
g=g_discrete_ex3 (w, delt) ' 

if(imag(g)*imag(gl ) >0.0) wl=w; else 
w2=w; end 


if(abs(imag(g))<0.000001) break; 

Command Window 

end 

» cor.versi or._d2c_ex2 

end 

wu=w; % uj^.|imat,e-frequency wu is found 
k=abs(g_discrete_ex3(0.0,delt) ); 
g=g_discrete_ex3(wu,delt) ; 
tau=sqrt(k A 2-abs(g) A 2)/abs(g)/wu; 
theca- (pi+atan (-tatt*wu) ) / wu; 

% tau: time conbSittt, theta: delay, 

k: static gain 

fprintf (' k=ffi^. 3f tauMlS . 3f theta=% 

5.3f \n',k,tau,theta) ; 

k=l.002 tau=2.320 theta=1.001 


where a x =-1.8142, a 2 = 0.82305, bi = 0.004443 and b 2 = 0.004425 1. d, = 5. The 
sampling time is At = 0.1. From (11.21) and the model parameters, it is clear that the transfer 
function is 


cH _X z )_ b l z~ 1 +b 2 z~ 2 __~ d _ 0 . 004443 Z - 1 + 0.004425 lz ~\_ 5 
^ Z) ~ u(z)~ l + diZ-'+az r- 2 ' _ 1 - 1 . 8142 - 1 + 0.82305 — 2 2 


( 11 . 22 ) 


Example 11.2 

Convert the discrete-time SOPTD model in Example 11.1 to the continuous-time SOPTD 
model. 


Solution The continuous-time SOPTD model by (11.10), (11.12) and (11.17) is 

G(s) = XX = 1.002exp(— 0.55.v) 

W u(s) 1,014 2 .y 2 + 2 x 1.014 x 0.984.V + 1 


( 11 . 23 ) 
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The MATLAB code for the model conversion from the discrete model to the continuous 
model is shown in Table 11.1. Note that the continuous-time SOPTD model obtained is very 
close to the real process in Example 10.3. Theoretically, if the sampling time is smaller, then the 
continuous-time model obtained is closer to the real process. 

Example 11.3 

Convert the discrete-time SOPTD model in Example 11.1 to the continuous-time FOPTD 
model. 

Solution The continuous-time FOPTD model by (11.18), (11.19) and (11.20) is 

,,, >■!■>■) 1.002exp(-1.002J) 

G(S) = W) ° 2.320, + 1 (11 24) 

The MATLAB code for the model conversion from the discrete model to the continuous 
model is shown in Table 11.2. 


Problems 


11.1 Activate the following process using a step input signal with a sampling time of 0.2 and 
estimate the ARX model with a known time delay. Compare the Nyquist plot of the ARX 
model and that of the process. 


d 3 y(f) d 2 y{t) 

Afi At 1 


3 dy(Q 

At 


+ y[t)=u{t- 0.2) 


11.2 Estimate an ARX model with an unknown time delay for the activated process data of 
Problem 11.1 and compare the Nyquist plot of the ARX model and that of the process. 

11.3 Estimate the OE models with an unknown time delay for the activated process data of 
Problem 11.1 and compare the Nyquist plots of the OE models and that of the process. 

11.4 Convert the discrete-time models of Problems 11.1-11.3 to a continuous-time FOPTD 
model and tune the PID controller using the IMC tuning rule and show the control 
performance of the PID controller for the process of Problem 11.1. 

11.5 Convert the discrete-time models of Problems 11.1-11.3 to a continuous-time SOTPD 
model and tune the PID controller using the ITAE-2 tuning rule and show the control 
performance of the PID controller for the process of Problem. 11.1. 

11.6 Activate the virtual process of Process 3 (refer to the Appendix for details) using a step 
input signal and estimate the ARX model an the unknown time delay. Next, obtain the 
continuous-time SOPTD model from the discrete-time ARX model and tune the PID 
controller using the ITAE-2 tuning rule. Finally, show the control performance of the PID 
controller for Process 3 (refer to the Appendix for details). 

11.7 Solve Problem 11.6 again with the OE model with an unknown time delay. 
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Part Four 

Process Activation 


The tuning of a PID controller or the design of an advanced model-based controller goes 
through the following steps. Step 1, activate the process with a test signal generator. Step 2, 
estimate the process model using the process identification algorithms. Step 3, tune the PID 
controller or design the advanced model-based controller. Step 2 and Step 3 are described in 
Part Three and Part Two respectively. This chapter talks about the test signal generator in 
Step 1. If the process is activated too aggressively, then the quality of the products from the 
process may not be acceptable and the safety of the process is not guaranteed. Meanwhile, if 
activation is not enough, then an accurate process model cannot be obtained because the 
information included in the activated data is limited and the uncertainties, such as measurement 
noise and disturbances, become dominant. So, the goals in Step 1 are activating the process in as 
short a time as possible and activating the dynamic information (frequency components) as 
much as possible. One of the most efficient methods for process activation is the relay feedback 
method. If the process is activated with the relay feedback method, then it is straightforward to 
detect the time-scale (ultimate period) of the process and what frequency components are 
included in the activated data. Then, it is easy to determine the termination time for the process 
activation and the design parameters (for example, the maximum frequency, the sampling time, 
the parameters of the weight) for the process identification methods. So, relay feedback 
methods and their modifications are introduced in this part. 




12 

Relay Feedback Methods 


In this chapter, the conventional relay feedback method is first introduced. It is the simplest and 
has been the most widely used in industry for a long time. In particular, it is one of the most 
important process activation methods for automatic tuning of a PID controller. Next, three 
important relay feedback methods recently developed to overcome the several problems of the 
conventional relay feedback methods are introduced. The first method activates the process 
with a guarantee of a symmetric oscillation under the circumstance of disturbances so that the 
describing function analysis method provides accurate frequency response data of the process. 
The second method can guarantee a symmetric oscillation under the circumstance of 
disturbances and nonlinearity. The third method can provide estimates for the frequency 
responses for which the phase angle is specified a priori and also manipulate a large range of 
operation, possibly larger than the magnitude of the relay. 

12.1 Conventional Relay Feedback Methods 

The conventional relay feedback method was proposed by Astrom and Hagglund (1984). It is 
the simplest among the various versions of relay feedback methods. Two types are available, 
according to the actual operations: unbiased relay and biased relay. 

12.1.1 Unbiased-Relay Feedback Method 

Chapter 8 in Part Three briefly explained how to activate a process using the unbiased-relay 
feedback method, and the MATLAB code for its implementation was introduced. Let us 
summarize it again. The symbol for an unbiased relay is shown in Figure 12.1 and the block 
diagram of an unbiased-relay feedback control system is shown in Figure 12.2. 

In Figure 12.1, the v-axis and the y-axis represent the input of the relay and the output of 
the relay respectively. From the symbol in Figure 12.1, it is clear that the relay output is d if the 
input is greater than zero; otherwise the relay output is —d. For example, the relay output will be 
the square signal in Figure 12.3 if the relay input is the sine signal asin(cuf)- 
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Input ^ 

of 


Output 



0 

-d 



Figure 12.1 Symbol of the unbiased relay. 



Figure 12.2 Block diagram of the unbiased-relay feedback control system to activate the process 
output. 



Figure 12.3 Relay output for a sine input. 


Now, consider the relay feedback control system in Figure 12.2 to activate the process. 
It should be noted that the relay input is 0 — y{t), where y(t) is the process output. So, the upper 
value d of the relay is applied to the process when the process output is less than the reference 
value of zero, and vice versa. That is, u(t ) = d if y(t) < 0 and u(t) = —d if y(t) > 0. 

Figure 12.4 shows the activated process input and the process output by the unbiased-relay 
feedback method, where y re tO) = 0 because it is the unbiased-relay feedback method. 

The detailed procedure for the unbiased-relay feedback method is as follows. First, the upper 
(on) value of the relay output is applied to drag the process output out of the initial value, 
as shown in Figure 12.4. Second, the lower (off) value of the relay is applied when the process 
output deviates from the initial state. Third, the upper value of the relay is applied when the 
process output is less than the reference value, and vice versa. That is, u{t) = d if y( t) < 0 and 
u{t) = —d if y(t) > 0. Then, the process input and output usually reach a cyclic steady state 
(which means that the period and the peak value of the process output do not change) after three 
or four cycles. 

The remarkable properties of the unbiased-relay feedback method are summarized as 
follows. First, the time-length of the process activation is automatically determined by the three 
or four on-offs of the relay. Second, it has no tuning parameters except the magnitude 
of the relay. Third, the main frequency component included in the process input and output of 
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Figure 12.4 Activated process output by the unbiased-relay feedback method. 

the cyclic-steady-state part is the fundamental frequency component. Fourth, the frequency of 
the cyclic steady state is very close to the ultimate frequency of the process. The first property 
and the second property make the activation method the simplest and easiest in implementation. 
The third property says that only the fundamental frequency response model from the cyclic- 
steady-state part can be estimated. 

Example 12.1 

Choose all the processes to which the unbiased-relay feedback method can be applied. 

(PI) G(s) = exp(— 0.5 j)/(s+ if 
(P2) G(s) = exp(-0.2s)/(l-f 1) 

(P3) G(s) = l/(s+ l) 3 
(P4) G(s) = l/(s + 1) 

(P5) G(s) = (— 0.2s + l)/(s+ l) 5 
(P6) G(s) = l/(s+ l) 2 

Solution Processes PI, P2, P3 and P5 have the ultimate frequencies, but P4 and P6 have 
no ultimate frequencies. So, the unbiased relay cannot be applied to processes P4 and P6. 
The unbiased-relay feedback system will produce a cycle in which the period converges to zero, 
resulting in no cyclic-steady-state cycling for processes P4 and P6. 

Example 12.2 

Activate the process G(s) = exp(—0.2 s)/(s + if using the unbiased-relay feedback method. 

Solution The activated process input and output and the MATLAB code to activate the 
process are shown Figure 12.5 and Table 12.1 respectively. 

Example 12.3 

Activate the process G(s) = exp(—0.2 s)/(s + if using the unbiased-relay feedback method 
when the process output is contaminated with uniformly distributed random noise between 
-0.1 and 0.1. 
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Table 12.1 ( Continued ). 
if(index==0) 

u=d; if(yy(i)>y_delta) index=l; 

end 

end 

j=l: 499 

c_data(j)=u_data(j +1); 

end 

u_data (500)=-tl; uu(i)=u; 

[x,y]=g_unbiased_relay_ex2(x, 

delt,u_data); 

end 

P=P_on+P^q'f|Jf:-'-a= (abs (ymax_f) +abs 
(ymin_f))/2; 

fprintf (’ Period =■%$•■< 4 f Peak Value = % 
7.4f Relay Magnitude = %7.4f \n', P, a, 
d) ; 

figure (1) ; plot (ttjfiayy, tt, yyr- 
ef) ; ] ] > 


Solution The activated process input and output and the MATLAB code to activate the 
process are shown Figure 12.6 and Table 12.2 respectively. In this example, the readers should 
pay attention to the technique to manipulate the measurement noise. If the MATLAB code of 
Table 12.1 is directly applied to the case of the measurement noise, then the relay output will 
show severe fluctuations around the zero-crossing point. So, the hysteresis is used to prevent the 
phenomenon, as shown in Table 12.2. The frequency of the oscillation moves to a lower 
frequency region compared with the ultimate frequency if the hysteresis is used. Note that the 
period in Table 12.2 is longer than that in Table 12.1 because of the hysteresis. 



Figure 12.6 Activated process output by the unbiased-relay feedback method for the case of 
measurement noise. 







350 


Process Identification and PID Control 


Table 12.2 MATLAB code to simulate Figure 

unbiased_relay_ex3.m 

clear; delt=0.01; tf=10; 
n=round(tf/delt); 

U_data=zeros(1,500); 
x=zeros (2,1); 
t_on=0.0; t_off=0.0; 

P_on=0; P_off=0; 
y=0.0; yref=0.0; np=0; 
index=0; y_de1ta-0.2; 
d=l.0; 

% ifp&lai phase : index=0, 
relay phase: index=l 
hys=0.1; index_up=l; 
index_down=0; ymin=0.0; 
ymax=0.0; 

rand('seed',0); noise=(rand 
(1,ri)-0.5)*0.2; 
for i=l: n 

t«i*dei%i. yy(i)=y+nd±se 
ft); yyref (i) =yref; fcfc(i) 

if(index==l) 

if(index_down==l& 
index_up==0 & yy (i) <*.fyref- 
hys) & yy(i—1)>(yrfef-hys)) 
index_up=l; 

index_down=0; ymin_f=ymin; 
ymin=0.0; 

t_on=t; P_off=t_on- 
t_off; 

end 

(index_up==l & 
index_down==0 & 
yy (i) > (yref+hys) &yy(i-l) 

<=(yref+hys)) 

index_up=0; 

index_down=l; ymax_f=ymax; 
ymax=0.0; 

t_of,4^t; 

P_on=t_off-t_Qh; np=np+l 
end 

,%f (index_down==l) 

u--d; if, (yy (i) >ymax) 
ymax=yy(i) ; end 

if (index_up==l) 


g_unbiased_relay_ex3.m 
function 

[next_x,y]=g_unbiased_relay_ex3 
(x, dej^^u) ; 

subdelt=delt; n^rcund(delt/ 
subdeit); 

A= [ 0 -1; 1 -2 ] ; B= [ 1; 0 ] ; C= [ 0 1 ] ; 
delay=0.2; 

delay_k=round(do 1ay/delt 
+ 0 . 00001 ); 
for i=l: n 

dx=A*x+B*u(500-delay_k); 
x=x+dx*subdeit; 
end 

next_x=x; yo=C*x; y=yo; 


command window 
» unbiasec_reiay_ex3 
Period = 2.4600 Peak Value = 0.2653 
Relay Magnitude = 1.0000 
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Table 12.2 ( Continued ) 

u=d; if(yy(i)<ymin) 
ymin=yy(i); end 
end 

if(index==0) 
u=d; 

: -,if (yy (i) >y_de 1 ta) 
iindex=l; 

•%.£ (yre f <y_de 1 ta) 
u=-d; index_up=0; 
index_down=l; end 
end 
end 

td* j=l: 499 

w_data(j)=u_data(j+1); end 
u_data(500)=u; uu(i)=il? 
P=P_on+P_off ; 

[x, y] = g_unbiased_ 
relay_ex3 (x, delt, u_data) 
end 

P=P_on+P_off; a= (abs 
(ymax_f)+abs(ymin_f))/2; 
fprintf (' Period = %7.4f Peak 
Value = %7.4f Relay Magnitude 
= %7.4f \n' , P, a, d) ; 
figure (1) ; plot (tt, yyref;> t^ 
uu, tt, yy) ; 


12.1.2 Biased-Relay Feedback Method 

Chapter 8 in Part Three briefly explained how to activate the process using the biased-relay 
feedback method, and the MATLAB code for its implementation was introduced. Let us 
summarize it again. The block diagram of the biased-relay feedback control system is shown in 
Figure 12.7 (Shen et al., 1996a). 

Now, consider the relay feedback control system in Figure 12.7 to activate the process. It 
should be noted that the relay input is y ref (t) — y(t), where y(t) is the process output and y re f( t) is 
the reference value for the relay on-off. So, the upper value d of the relay is applied to the 
process when the process output is less than the reference value y re f(0> and vice versa. That is, 
u(t ) = d if y(t) < y re f(t) and u(t) = -d if y(t) > y ref (t). 



Figure 12.7 Block diagram of the biased-relay feedback control system to activate the process output. 
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Figure 12.8 Activated process output by the unbiased-relay feedback method with y re f(0 = 0.3. 


Figure 12.8 shows the activated process input and the process output by the biased-relay 
feedback method with y ref {t) = 0.3. 

The remarkable properties of the biased-relay feedback method are summarized as follows. 
First, the time-length of the process activation is automatically determined by the three or four 
on-offs of the relay. Second, it has no tuning parameters except the magnitude of the relay and 
the reference value. Third, the frequency components included in the cyclic-steady-state part 
are the two frequency components corresponding to zero and the fundamental frequency. 
Meanwhile, the initial (unsteady-state) part of the activated process input and the process 
output includes various frequency components. Fourth, the frequency of the cyclic steady state 
is different from the ultimate frequency of the process. The fundamental frequency of the 
biased-relay feedback control system is lower than that of the unbiased-relay feedback control 
system. The first property and the second property make the activation method the simplest and 
easiest in implementation. The third property implies that only the two frequency response data 
of the zero and fundamental frequency from the cyclic-steady-state part can be identified, while 
many other frequency response data from the initial (unsteady-state) part of the process input 
and output can theoretically be obtained. The fourth property means that the ultimate frequency 
response data from the cyclic-steady-state part cannot be estimated. 

Example 12.4 

Simulate Figure 12.6 again with y ref (f) = 0.3. 

Solution The simulation results are shown in Figure 12.8. It is straightforward to obtain the 
simulation results in Figure 12.8 by replacing yref = 0.0 in Table 12.2 by yref = 0.3. 

12.2 Relay Feedback Method to Reject Static Disturbances 

Consider the process input and the process output in Figure 12.8. Clearly, the process input u{t) 
is asymmetric (that is, the two half periods are totally different) because y ref (t) is not zero. This 
phenomenon results in two problems. First, the fundamental frequency is far from the ultimate 
frequency. Second, the harmonics terms become too large to be neglected. Then, the describing 
function analysis method cannot provide acceptable accuracy in estimating the frequency 
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response model for the ultimate frequency. Fourier analysis can estimate the frequency 
response exactly for the fundamental frequency, but the estimate is not for the ultimate 
frequency because the fundamental frequency is far from the ultimate frequency. 

In this section, a relay feedback method is introduced to prevent the phenomenon. Consider 
the relay feedback control system in Figure 12.9 (Shen et al., 1996b; Park et al., 1997). It 
removes the effects of disturbances or input reference value y ref t7) by adjusting the output 
reference value M ret < t) for the relay on-off as much as the disturbance. Here, u r (t) and u(t) are 
the relay output and the process input respectively. 

Park et al. (1997) and Shen et al. (1996b) proposed the following update rule for u ref {t): 



where a max ,jt —i and flmin.t-i are the (k — l)-th peak value and the (k — l)-th valley value of the 
process output. u ref jc is the Arth reference value, a is the tuning parameter to compromise 
between the convergence rate and the robustness. 

Figure 12.10 shows the responses of the process G(s) = exp(—0.2 s)/(s + 1 ) 2 controlled by the 
relay feedback method for static disturbance rejection. A static disturbance of 0.3 is added to 
the relay output from the beginning of the relay feedback test. The update of u r ef(t) starts from the 
second cycling. The tuning parameter is chosen as a = 0.5. As expected, u(t) and y(t) become 
symmetric in the cyclic steady state, as shown in Figure 12.10, because the update rule of (12.1) 
adjusts M re f(t) as much as the static disturbance. Also, the update rule provides an acceptable 
convergence rate. The MATLAB code to simulate Figure 12.10 is shown in Table 12.3. 



Figure 12.9 Block diagram of the relay feedback control system to remove static disturbances. 



Figure 12.10 Response of the process for the relay feedback method to remove static disturbances. 









354 


Process Identification and PID Control 


Table 12.3 MATLAB code to simulate Figure 12.10. 

relay_Dl.m 

clear; delt- : 0,01; tf=20; n=round (tf/delt) ; 
u_data=zeros(1,500) ; x=zeros(2,1);' 
t_on=0.0; t_off=0.0; P_on=0; P_off=0; 

y=0.0; yref=0.0; np=0;index=0; y_delta=0.2; d=l.0?-fiis=0.3; 

% ipicfcial phase : index=0, relay phase : index=l 

hys=0.05; index_up=l; index_down=0; ymin=0.0; ymax=0.0; ure:-0.0; 
rand( ' seed',0); noise=(rand(1,n)-0.5)*0,05; 
for i=l: n 

t=i*delSj:' yy (i) =y+tipjfse (i) ; yyref (i)=yref; 
if(index==l) 

;fi(Index_down==l &index_up==0 & yy(i)<=(yref-hys) & yy(1-1) > 
(yref-hys)) 

index_up=l; index_down=0; ymin_f=ymin; ymin=0.0; 

t_on=t; P_off=t_on-ihoff; 

end 

(index_up==l & index_down==0 & yy (i) > (yref+hys) & yy (i*-4) <= (yref 
+hys)) 

:ndex_up~0; index_down=l; ymax_f=ymax; ymax=0.0; 

_fe^off=t; P_on=t_off-t_on; np=np+l; 

:|,f (np>=2) 

u ref-u re: -C . 5* (ymax_f+yrrtin_f) *d/ (abs (ymax_f) +abs (ymin_f) ) ; 
end 
end 

if (index_down==l) 

ur=-d;if(yy(i)>ymax) ymax=yy(i); end 

end 

if (index_up==l) 

ur=d; if(yy(i)<ymin) ymin=yy(i); end 
end 

if (index==0) 
ur=d; 

■0 (yy(i)>y_delta) 
index=l; 

if (yref<y_delta) ur=-d; index_up=0; index_down=l; end 

Sor j=l: 499 u_data (j ) =u_data (j+1) ; end 
p_data (500) =uf+ufef+dis; uu (i) =ur+uref)M3®ref (i) =urefij 
P=P_on+P r _off 

[x, y] = g_relay_Dl (x, delt, u_data) ; 
end 

P=P_on+P_off; a=(abs(ymax_f)+abs(ymin_f))/2; 

fp^llSitf (' Period = %7.4f Peak Value = %7.4f Relay Magnitude = %7.4f \n* t P, a, 
d) ; 

figure (1) ; plot (tt, yy re f:, tt, yy, t, uu ref, tt, uu) ; 
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Table 12.3 ( Continued ) 


g_relay_Dl.m 

function [next_x,y]=g_relay_Dl(x,delt,u); 
subdelt=delt; n=round(delt/subdelt); 

A= [ 0 -%fi -2 ] ; B= [ 1; 0 ] ; C= [ 0 1] ; delay=0.21 
delay_k=2‘<ditind (delay/delt+0 . 00001) ; 
for i=l:n 

dx=A*x+B*u(500-delay_k); 
x=x+dx* subset p.; : 

next_x=x; yo=C*x; y=yo; 

return 

end 


command window 

» reiay_Dl 

Period = 2.6300 Peak Value = 0.222.5 Relay Magnitude = 1.0000' 


The relay feedback method to reject the disturbance can be applied to the biased- 
relay feedback method. As shown in Figure 12.8, the biased relay with y ref (t) = 0.3 cannot 
provide a symmetric oscillation, resulting in larger harmonics. This problem can be 
easily solved by defining a new variable of )Vw(0 = y(f) — >Vetf 0 and applying the relay 
feedback method for the disturbance rejection to the new variable of y new (t) instead of the 
process output y(t). As shown in Figure 12.11, it successfully obtains a symmetric 
oscillation at y ref (f) = 0.3. The MATLAB code to simulate Figure 12.11 is shown in 
Table 12.4. 



Figure 12.11 Response of the process for the relay feedback method to remove static disturbances with 
.'VetfO — 0.3. 
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Table 12.4 MATLAB code to simulate Figure 12.11. 

relay_D2.m 

clear; delt- : 0,01; tf=20; n=round (tf/delt) ; 
u_data=zeros(1,500) ; x=zeros(2,1);; 
t_on=0.0; t_off=0.0; P_on=0; P_off=0; 

y=0.0; yref_new=0.0; yref=0.3; np=0; index=0; y_delta=0.2; d=1.0; 

% iSSjtjtial, phase : index=0, relay phase : index=l 
index_up=l; index_down=0; ymin=0.0; ymax=0.0; uref=0.0; 
for i=l: n 

t=i*delt; yy_new (i) =y-yref; yy yyref (i) =yref; tt(i),«,t$ 

if(lndex==l) 

4*(index_down==l & lndex_up—0 & yy_new(i)<=yref_new& yy_new(l-l) 
>yref_new) 

index_up=l;index_down=0; ymin_f=ymin; ymin=0.0; 
t_on=t; P_o f f=t_on-t_o f f; 

end 

. TjLf (index_up==l & index_down==0 & yy_new (i) >yref_new & yy_new(i-l) 
<=yref_jiew) 

index_up=Q:; index_down=l; ymax_f=ymax; ymax=0,0; 
t_off=t; P_on=t_off-t_on; np=np+l; 

if(np>=2) uref=uref-0.4*(ymax_f+ymin_f)*d/(abs(ymax_f)+abs 
(ymin_f)); end 
end 
end 

if(index_down==®f’ 

ur=-d;if(yy_new(i)>ymax) ymax=yy_new(i); end 
end 

'If (index_up==l) 

ur=d; iif. (yy_:new (i) < y m in) ymin=yy_new (i) ; end 
end 

if(index==0) 
ur=d; 

if(yy_new(i)>y_delta) 
index=l; 

if(yref_new<y_delta) ur=-d; index_up=0; index_down=l; end 
end 
end 

for j=l: 499 u_data (j ) =u_data (j+ii f end 

u_data (500)=ur+uref; uu (i)=ur+uref; uuref (i) =uref; P=P_on+P_of f ; 

[x, y] = g_relay_D2 (x, delt, u_data) ; 
end 

P=P_on+F^tti"-a= (abs (ymax_f) +abs (ytefcn_f) ) /2; 

fprintf (' Period = %7.4f Peak Value = %7,4 i Relay Magnitude = %7.4f\n' , P,a, 
d) ; 

figure (1) ; plot (tt, yyref, tt, yy, tt, uuref, tt, uu) ; figure (1) ; pl‘£® (tt, yyr¬ 
ef, tt, yy, tt, uuref, t%>®u) ; 


g_relay_D2 .aj 

function [next_x,y]=g_relay_D2(x,delt,u); 
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Table 12.4 ( Continued) 

subdelt=delt; n=round(delt/subdelt) ; 
A=[0 -1;1 -2] ; B=[1 t0] ; 

1] ; delay=0.2 ; 

delay_k=g$|jnd (delay/delJftfcO . 00001) ; 
for i=l: n 

dx=A*x+B*u(500-delay_k); 
x=x+dx* subdelt/ 

next_x=x; yo=C*x; y=yo; 


command window 

» relay_D2 

Period = 2.1500 Peak Value = 0.1342 Relay Magnitude = 1.0000 


12.3 Relay Feedback Method under Nonlinearity and Static Disturbances 

The relay feedback method introduced in this section is used to manipulate output nonlinea¬ 
rities and static disturbances. Let us call it Relay_ND. It guarantees the symmetry of the relay 
output by setting the time length of the relay off to the half period of the previous cycle. And it 
rejects the effects of static disturbances and output nonlinearity by changing the input reference 
value of the relay. Relay_ND can be successfully applied to identify a Wiener-type nonlinear 
process with a static disturbance. 

It activates the process using the following algorithm (Sung and Lee, 2006): 

u(t)= -d for t 0 ff,fc < t < t oi f tk + ^y 1 (12.2) 

W = l ots ,k + yy, yref,k = >’(W) for t = t 0 ff,* + yy (12.3) 

u(t) = d for + yy < t<t oi f, k + 1 (12.4) 

?off,*r+1 =t, P k = t 0 &M i “ t 0 ffjc for t > + 1 ‘ 5I> 2~ 1 > ^ref,* (12.5) 

where u(t ) and y(t) are the relay output and the process output respectively. y re f,*, R*, t 0 ff,/c 
and t on ,yt are the reference value, period, time for relay off and time for relay on of the Mi cycle. 
The algorithm can be represented graphically as shown in Figure 12.12. 

The remarkable difference between the conventional relay and Relay_ND is that Relay_ND 
uses the half period of the previous cycle to determine the relay off, which produces a symmetric 
cycling, while the conventional relay uses the point at which the process output crosses the 
reference value, which means that it has no equipment to enforce a symmetric cycling. 
Equation (12.4) enforces the symmetry of the relay output in the cyclic steady state. 
y re f,* = y(ton,k) in (12.3) makes the two crossing points in one cycle between the process output 
and the reference value converge to the same value, which rejects the effects of static 
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Figure 12.12 Relay feedback method under nonlinearity and static disturbance conditions. 


disturbances. For the case of severe measurement noise, it is recommended that >’ re f,/ c = a \ 
+ a 2 P/2, where a x and a 2 are the estimates of the least-squares method of which the object 
function is 


™'a 2 ~ ai ~ a2 ^ U ~ 

i=l 

subject to 

P/2 — aP < ti — t Q ff < P/2 

P and t off are the previous period and the time corresponding to the recent relay off. 
The effects of the measurement noise decrease as a increases, but a should be small 
enough for y to be approximately linear with respect to t within the time span PI2 — aP < 
t-t otf <P/2. 

Example 12.5 

Simulate Relay_ND for the case of no noise (a = 0) and a static input disturbance d = —0.5 
with the process y{s)/u{s) = exp(-0.5.s)/(,y + l) 2 . 

Solution The MATLAB code to simulate Relay_ND and the results are shown in Table 12.5 
and Figure 12.13 respectively. The estimate for the ultimate period is close to the true value of 
3.27 even under the circumstance of the static disturbance. 

Example 12.6 

Simulate Relay_ND for the case of measurement noise (a = 0.1) and a static disturbance 
d=— 0.5 with the process y(s)/u(s) = exp(—0.5.y)/(.y + l) 2 . The measurement noise is uni¬ 
formly distributed random noise between —0.05 and 0.05. 


Solution The MATLAB code to simulate Relay_ND and the result are shown in Table 12.6 
and Figure 12.14 respectively. It shows acceptable robustness to the measurement noise. 
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Table 12.5 MATLAB code to simulate Example 12.5. 

relay_NDl.m 

clear; 

t=0; tf=35.0; deltrtft;. 01; n=round(tf/delt) ; 

y=0; x=[0;0]; delay=0.5; n_delay=round(delay/delt) ; 

u=zeros(1,500) ; u_relay=0; dis=-0.5; d=1.0; 

yref=0.0; yre: _o,n-C ; 

tref=0.0; Lot :'_ref‘-0.0; ton_ref=0.0; 

ffi=0; index=0; y_delta=0.1; 

for k=l:n 

'fi_relay_b=u_relay; % one sampling before : u_relayb 
tp-f-tref; t-- to f f_re f ; -_on-t-ton_re f ; 

4-f (index==0) 

u_relay=d; toff_ref^|j p=t; if(y>y_delta) index=l; end 


* (m<2) % conventional telay 

if ( (y>yref) & (ton>p/4)) u_relay=-d; end 
/Jfll((y<yref) & (toff>p/4)) u_relay=d; end 
else % relay_ND 

if(tp<p/2) u_relay=-d; end 
if (tp>=p/2) u_relay=d; end 

il ( (tp>=l.5*p/2) & (y>yref)) u_relay=-d; end 
yref-yref_on; 

end 

if ( (u_relay==-d) & (u_relay_b==d) ) % when relay off 
m=m+l; p=tp; tref=t; toff_re^<^ 

end 

(u_relay==d) & (u_relay_b==-d) ) % when relay on 
ton_ref=t; yref_on=y; sumy=0.0; 
end 
end 

for i=l:499 u(i)=u(i+1) ; end 
u(500)=u_relay+dis; 

Sfiftlk)=u_relay; tm(k)=t; ym(k)=y; yr(k)=yref; 

[x, y] =g_relay_NDl (x, u (50C“.n_de 1 ay) , delt) ; 
t=t+delt; 

fprintf (' Pu=%5.2f y_ref=%5.2f \n' , p, yref) ; 
figure (1) ; plot (tm, ym, tm, uitt, tm, yr) ; 


g_relay_NDl.m 

function [x,y]=g_relay_NDl(x,u_delay,delt) 
A=[0 -1 ; 1-2 ] ; B=[1 ; 0 ] ; C=[0 1 ] ; 
x=x+(A*x+B*u_delay)*delt; 
y=C*x; 


command window 

» relay_NDl 

Pu= 3.32 y_ref =-0 {ft 
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Figure 12.13 Simulation results in Example 12.5. 


Example 12.7 

Estimate the ultimate frequency data of the linear dynamic subsystem (12.7) and the output 
nonlinear static function (12.8) using Relay_ND for the following Wiener process: 

w(t) = u(t)+0.15 (12.6) 


_ G M _ ex P(~ °- 5 ' y ) 

<?) ‘ (.v+1) 2 


(12.7) 


y(0 = 1 — (1 +z(t)/3.0)exp(— 3.0z(t)) (12.8) 

The process output is contaminated by uniformly distributed random noise between —0.05 


Solution The activated process output by Relay_ND is shown in Figure 12.15 and the 
MATLAB code is shown in Table 12.7. 

The estimate for the ultimate period is close to the true value of 3.27 even under the 
circumstance of the static disturbance and output nonlinearity. Now, let us estimate the output 
nonlinear static function. The relay output is known to be approximately u{t) = (4<i/jt;)sin(wt). 
Here, w is the relay frequency. Then, z(t) in the cyclic steady state is approximately 
z(f) w 0.15G(0) — (4r//7t)IG(im)lsin(wt). Let us parameterize the model for the output nonlinear 
function in the form z(f) = giy + giy 1 + g^y 3 + ■■■ + g„y". Then, the normalized model 
parameters of f k , k = 1,2,... ,n, can be obtained by solving the following optimization 
problem using the least-squares method: 

m j n ^[-^■^G{{)) + {Ad/n)\G(i(o)\sin{(ot k ) + g l y k + g 2 ^ k + g i yl+ ••• +g n f k ] 2 


= min sin(mfi) — 

* k=\ - 


0.15G(0) 
{Ad / n)\G{i<o)\ 


g\yk + g 2 yl+hyj + • • • + LA' 

(Ad / n)\G(ia))\ 


~ min ^ [sin(mtfc) +/ 0 +fiM +fiyl +fiA + " ' +/«>'ifc] 2 
f k=i 


(12.9) 
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Table 12.6 MATLAB code to simulate Example 12.6. 

relay_ND2.m 

clear; 

t=0; tf=35.0; deltrtft;. 01; n=round(tf/delt) ; 

y=0; x=[0;0]; delay=0.5; n_delay=round(delay/delt) ; 

u=zeros(1,500) ; u_relay=0; dis=-0.5; d=1.0; 

yref=0.0; yref1Q»=0 ; 

tref=0.0; tof f_ref=0 ,Q; ton_ref^ft..O; 

at=0; index=0; y_delta=0.2; 

rand('seed',0); noise=(rand(1,n)-0.5)*Q.1; 
sl=0; s2=0; s3=0; s4=0; s5=0; 
for k=l:n 

da_relay_b=u_relay; % one sampling before : u_relayb 
tp=t-tref; tof f =t-toff_ref; ton=t-ton_ref; 
if(index==0) 

y_relay=d; t©:ijjLref=t; p=t;). jifl (y>y_delta) index=l; end 
else 

.if (m<2) % ccnven uiO,na 1 relay 

if((y>yref) & (ton>p/4)) u_relay=-d; end 
if((y<yref) & (toff>p/4)) u_relay=d; end 
else % relay_ND 

%(tp<p/2) u_relay=-d; end 
^E(tp>=p/2) u_relay=d; end 

((tp>=l.5*p/2) & (y>yref)) u_relay=-d; end 
if((tp>=(p/2-p*0.1)) & (tp<(p/2))) 
sl=sl+l; s2=s2+tp; s3=s3+tp A 2; 
s4=s4+y; s5=s5+y*tp; 

end 

yref=yref_on; 

end 

if((u_relay===d)&(u_relay_b==d)) % when relay off 
m=m+l; p=tp; tref^t; toff_ref=t; 

end 

4f ( (u_relay==d) & (u_relay_b==-d) ) % when relay on 
if(m>=2) 

theta=inv([si s2 ; s2 s3])* [s4;s5]; 
yref_on=theta(1)+theta(2)*p/2; 

end 

sl=0; s2=0; s3=0; s4=0; s5=0; ton_ref=t; 
end 
end 

imt i-l: 4 99 u|il =u £tf|t) i end 
11 (500) -u_re lay+dl s; 

4im (k) =u_relay; tm(k)=t; ym(k)=y; yr(k)=yref; 

[x,yo]=g_relay_ND2(x, u(500-n_delay),delt); 
y=yo+noise(k); t=t+delt; 

end 

fpnntf {'Pu=%5.2f y_reff=%5.2f \n' ,p,yref) ; 
figure (1) ; plot (tm, ym, tm,um, tm, yr) ; . 
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Table 12.7 MATLAB code to simulate the case of a static disturbance plus measurement noise in 
Example 12.7. 

relay_ND3.m 

clear; 

t=0; tf=35.0; del#*$.. 01$;#=round!&l/delt) ; 

y=0; x=[0;0]; delay=0.5; n_delay=round(delay/delt) ; 

u=zeros(1,500); u_relay=0; dis=0.15; d=1.0; 

yref=0.0; yref_on=0; 

tref=0.0; toff_ref=G,G; ton_ref=Q>0; 

m=0; index=0; y_delta=0.2; 

rand (' seed', 0) ; no ;.sc- ( ranc (1, n) - 0.5) *0.1; 
sl=0; s2=0; s3=0; s4=0; s5=0; j=0; 
for k=l: n 

u_relay_b=u_relay; % one sampling before : u_relayb 
tp=t-tref; toff=t-toff_ref; ton=t-ton_ref; 
if(index==0) 

,: gLrelay=d; P=|j$t4-f (y>y_delta) index=l; end 

else 

if (m<2) % conventional relay 
if((y>yref) & (ton>p/4)) u_relay=-d; end 
if((y<yref) & (toff>p/4)) u_relay=d; end 
else % relay_ND 

; -gif(m==10) j=j+l; data_y_u(j,1:3)-[tyu_relay]; end 
?&L£ (tp<p/2) u_relay=-d; end 
if (tp>=p/2) u_relay=d; end 

if ( (tp>=l.5*p/2) & (y>yref)) u_relay=-d; end 
if ( (tp>=(p/2-p*0.1)) & (tp<(p/2))) 
sl=sl+l; s2=s2+tp; s3=s3+tp A 2; 
s4=s4+y; s5=s5+y*tp; 

end 

yref=yref_on; 

end 

if((u_relay==-d)&(u_relay_b==d)) % when relay off 
m=m+l; p=tp; tref=t; toff^ref=t; 

end 

if ( (u_relay==d) & (u_relay_b==-d) ) % when relay on 
if(m>=2) 

theta=inv([si s2 ; s2 s3])* [s4;s5]; 
yref_on=theta(1)ttheta(2)*p/2; 

end 

sl=0; s2=0; s3=0; s4=0; s5=0; 
end 
end 

for i=l: 499 u (i) =u (i+1) ; end 
tl (500) =u_relay+dis; 

(k)=u_relay; tm(k)=t; ym(k)=y; yr(k)=yref; 

[x,yo]=g_relay_ND3(x,u(500-n_delay),delt); 
y=yo+noise(k); t=t+dei[fc^ 
end 
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Table 12.7 ( Continued) 

fprintf (' Pu=%5.2f y_ref=%5.2f \n' ,p,yref) ; 
figure(1); plot(tm,ym,tm,um,tm,yr); 

g_relay_JJD3 .m 

functl<@gC [x, y] =g_relay_ND3 (x, u_delay, delt) 
A=[0 -1 ; 1 -2 ] ; B=[l ; 0 ] ; C=[0 1] ; 
x=x+(A*x+B*u_delay)*delt; 
z=C*x; y=l-(l + z/3.0)*exp(-3.0*z) ; 



where the normalized model parameters / 0 ,/i, • • • ,/„ correspond to — 0.15G(0)/ 
{Ad\G{icj)\/n), (4i/|G(i<w)|/zr), .. g„(^d\G{i(o)\/n) respectively. If the normalized 
model G m (s) is defined for the normalized process G(,y)/(4c/IGti<w)l/K), then the ultimate 
amplitude ratio is one and the model for the output nonlinear static function is 
z{t) =f\}’k + f 2 yl +/ 3 >i + ••• +f n y'k • Because the overall input-output relation of the 
original process is the same as that of the normalized process, the model of IG m (i«)l = 1 and 
z(t) = f\}’k + hyl +/ 3 >i + ••• +f n y'k obtained is acceptable. The output nonlinear static 
models of z(t) = 1.417y+ 1.146y 2 — 0.020y 3 is obtained from (12.9). Figure 12.16 shows the 
performances of the model. It is remarkable that the nonlinear process with the output 
nonlinearity and static disturbance can be identified using only one relay test. The MATLAB 
code to estimate the output nonlinear function is shown in Table 12.8. The code should be 
executed after the code in Table 12.7 is executed, because it uses the activated process input and 
output data generated by the code in Table 12.7. 



Figure 12.16 Identificai 


;sults for the output nonlinear static function in Example 12.7. 
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Table 12.8 MATLAB code to estimate the nonlinear function for the case of a ramp disturbance plus 
measurement noise in Example 12.7. 

relay_ND3_nonlinear.m 

n=length (data_y_u) ; %data_y_u (:,l:3) = [tyu] 
period=data_y_u(n,1)-data_y_u(1,1); w=2*pi/period; 
fop &—1: n 

matrix [1,1) =-l; matrix (i,2)=data_y_u(i, 2) ; 
matrix(i,3)=data_y_u(i,2) A 2; matrix(i, 4)=data_y_u(i,2) A 3; 
matrix_y(i,1)=sin(w*(i—1)*delt); 
end %Estimate the inverse f of y=f (z) 
coeffs'inv (matrix' *matrix) *matrix' *matrix_y; 
fppxafcfC'wu=%5.3f \n' ,w) ; 

fppfhtf ( , fl=%5.3f, f 2=%5.3f , f3=%5.3f|ijp*,coeff (2) ,coefft3) ,coeff (4) ) ; 

% comparison of the model and the process 

ymax=max(data_y_u(:,2)); ymin=min(data_y_u(:,2) ) ; 

s=complex (0,1) *w; ; §jw=exp (-0.5*s) / (s+1) A 2; normal=pi/ (4*abs (giw) *d) ; 
for i=l: 50 

y=ymin+(ymax-ymin)*i/50; 

z=coeff(2)*y+coeff(3)*y A 2+coeff(4)*y A 3; %model 
mz(i,1)=z/normal;my(i,1)=y; %my=f(mz) 

figure (3) ; z=min (mz) : ( (max (mz.) -min (rtiz) ) /50.0) :max (mz) ; 
nn=length(z); 
f or isl: nn 

y(i)=l-(l+z(i)/3.0)*exp(-3.0*z(i)); 

plot (z, y, ' r' ) ; hold on %real nonlinear function plotting 
plot (mz,my) ; %model nonlinear fhin’Ction 


command window 

» relay_ND3_nonlinear 
wu=l.893 

f 1=1.417, f2=l. 146 , f:3=-0.020 


12.3.1 Concluding Remarks 

Relay_ND has been proposed to manipulate output nonlinearities and static disturbances. 
It guarantees a symmetric relay output by setting the time-length of the lower value of the relay 
to the half-period. Also, it rejects the effects of static disturbances and output nonlinearity by 
changing the input reference value of the relay. 

12.4 Relay Feedback Method for a Large Range of Operation 

This section introduces the two-channel relay feedback method to guarantee a prespecified 
phase angle of the model under a large range of operation, possibly larger than the magnitude of 
the relay (Sung et al., 2006). Let us call it Relay_LO. It uses a conventional relay followed by 
two channels, a proportional channel and an integrator plus relay channel. The phase angle can 
be specified easily by adjusting the ratio of the two gains of the two channels. It removes the 
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effects of static disturbances, meaning that one need not define the deviation variables initially, 
which is very attractive from a practical point of view. 

It initially raises the process output up to the reference value y re f using the startup mode and it 
uses the normal mode for the normal operation. The detailed algorithm is as follows: 


For the startup mode: 


For the normal mode: 


«t(0 = 1 fory(t) <yref 

(12.10) 

Ui(t) = - 1 fory(t) > y ref 

(12.11) 

s{t) =K S [ zzi(r) dr 

Jo 

(12.12) 

ZZref(0 = 4t) 

(12.13) 

u{t) = K p Ui(t) +M rcf (t) 

(12.14) 

u 2 {t) = 1 for.v(t) <.v rcf (t) 

(12.15) 

U 2 (t) = - 1 fors(t) > Jref(t) 

(12.16) 

«p(0 = K pMt) 

(12.17) 

u\{t) = KMt) 

(12.18) 

«(0 =«p(0 + “i(0 + « r ef(0 

(12.19) 


Equations (12.10) - (12.11) and (12.15) - (12.16) are relay 1 and relay 2, respectively. K s in the 
startup mode is to adjust the speed of the process input for the process output to reach up to y ref . 
Note that u(t ) in the normal mode is composed of the two channels 

Ch. 1: y ref - y(t) -> Relay 1 -> u x (t) -> u v (t) 

and 

Ch.2:y ref — y(t) —>Relay 1 —> zq (f) —> Integrator—> .s- rc f(0 - s(t) —>Relay 2—> u 2 (t) —>Ui(t) 

s ref (t) and M re f( t) are updated each half-cycle of zzfiZ) and each cycle of zq (/) respectively by 
the following update algorithms: 


and 


^ref,fc+ 1 ij) 


■Sina x,k + ■S'min.A 
2 


<rcf.A » I (/) = U rc r,k(t) + 


a (K p + Kj)(P on, A — P off 
Ron,A + P off ,A 
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with the initial value of w re f,i(0 = (.y max , i + .y m in,i)/2 for k = 1,2,3,_Here, k denotes the kth 

cycle of s m .„j c and are the maximum value and the minimum value of s(t) during the 

Mi cycle. P (m jc and P 0 ff,k denote the time-lengths corresponding to the relay on and the relay off 
respectively of relay 1. 

The update rule of w ref makes the process input symmetric (equivalently, the time-average 
value of the process input is zero) to reject the effects of static disturbances. 

(K p + K i )(P oa , k -P oS jc) 

P on,k + P off.tr 

is the time-average value of the process input of the Mi cycle. Then, the update rule can 
be derived: 


(.. t,\ i a (^p+^0(^on,i Pofl,k) 

ef.Ar+lW —U refk (t)-\ ---—- 

Pon,k + Poff,k 


a= 1.5—2.0 is recommended with a compromise between the convergence rate and the 
robustness. A larger a increases the convergence rate while it decreases the robustness. The 
update of .y re f,fc+ iW = (.y ma x,/c + .y m in,/t)/2 is to make u 2 (t ) symmetric. 


The describing function for Ch. 1 is 


The describing function for Ch. 2 is 


because the integrator of (12.12) shifts the phase as much as —Jt/2. Then, the overall describing 
function of the two-channel relay feedback method is (12.20). 


N(a)=K p —-iKi — = —(K p -iKi) (12.20) 

na na na 

where a is the peak value of the process output. Then, the identified frequency response model 
is (12.21) and (12.22): 


1 na(K p + iAj) 

N(a)~ 4 (Ki+K?) 


( 12 . 21 ) 


ZG(iw) = — 7i + arctan f — 


(12.22) 
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Figure 12.17 Process activation by the two-channel relay feedback method in Example 12.8. 


From (12.22), it is clear that the phase angle of the model ZG(itn) can be set by adjusting the 
ratio of KJK p . 

Example 12.8 

Simulate the two-channel relay for the following process. The step input disturbance of 1.0 
enter at t = 30.0. 

G(#=2.0 eXP( -°f? (12.23) 

(5+1) 

Solution The activated process output is shown in Figure 12.17 for the case of K p = 1.5, 
Ki = 0.5 and /Z s = 1.0. The MATLAB code to simulate Figure 12.17 and Example 12.8 is shown 
in Table 12.9. 

Table 12.9 MATLAB code to simulate the two-channel relay in Example 12.8. 

relay_LD_exl.m 

clear; tf=60.0; delt=0.01; tf_k=round(tf/delt); 
relayl-Q.0; relay2=0.0; relay2b=0.0; u=zeros(1,500); 
uu=0.0; x=zeros (2,1); y=0.0; yb=0.0; 
sum=0.0; sumb=0.0; sumref=0.0; 

sum_min=0.0; sum_max=0.Of y_max=-10 A 10; y_min=10 A 10; 
number=0; yref=10.0; uref=0.0; 
kp=1.5; ki=0.5; ks=1.0; 

umax=100.0;:^Ste»-100.0? Lndex=0; y_delta=0.2; 
for k=l: Lf^k 
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Table 12.9 ( Continued ) 


fee (k-l)*delt; T(k)=t; Y (k)—y; U(k)=uu; 

Up(k)=relayl; Ui(k)=relay2; Uref(k)=uref; 

Sum(k)=sum; Sum_ref(k)=sumref; 
for x=l: 499 u } =u (i+1) ; end 
41 (index==0) %before relay feedback 
relayl=l.0; 
if(y>y_delta) 

index=l; t_of f=tf 't_on=tt ( 0; Pon=t; 

Poff=0; Period=2*Pon; w=2*pi/Period; 

end 

else 

§xf (y-yref>=0.0 & yb-yref<0.0) 

sum_max=sum; a_max=y_max; y_max=-10.0 A 10 ; 
t_off=fc; Pon=t-t_on; P=Pon+Poff; w=2*pi/P; 
number=number+l; 

(number==2) uref= (sura_max+sura_rain)/2; end 
(number>=2) 

uref=uref+i-*S' #r (kp+ki) * (Pon-Poff) /P; 
if(number>=2) sumref=(sum_max+sum_min)/2; end 

end 

l-f (y>yref) relayl=-l; if(y>y_max) y_max=y; end; end 
ff (y-yref<=0.0 & yb-yref>0.0) 

sum_min=sum; a_min=y_min; y_min=10.0 A 10; 
if(number>=3) sumref=(sum_max+sum_min)/2; end 
t_on=t; Poff=t-t_off; 

end 

ff (y<=yref) relayl=l||i : -lif(y<y_Jttin) y_min=y; end; end 
sum=sumb+ks*relayl*delt; 
if(sum>umax) sum=umax; end % saturation 
if(sum<umin) sum=umin; end 
if(sum<=umax & sum>=umin) sumb=sum; end 
;|.f (r.ur.ber<2) 

uref=sum; %relay2=0; 
else 

if (sum>=sumref) relay2=ki; end % square signal 
if (surrKsumref) relay2=-ki; end % square signal 
end 
end 

-t^-f (t>30) dis=1.0; elsedis=0.0; end 
;|iu=kp*relayl+relay2+uref; u (500) =uu+dis; yb=y; 

[x,y]=g_relay_LD_exl(x,delt,u); 
end 

a=(a_max-a_min)/2; giw=-pi*a*(kp+complex(0,1)*ki)/(kp A 2 + ki A 2)/4; 
fpbfptf('w=%5.3f, giw=(%5.3f)+i(%5.3f) \n',w,real (giw),imag(giw)); 
figure(1); plot(T,Y,'b',T,Up,'g',T,Ui,'r', T,Uref,'c',T,Sum,'k', T, 
Sum_ref,'y'); 
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Table 12.9 ( Continued ) 


g_relay_LD_exl .rti 

function [next_x,y]=g_relay_LD_exl(x, delt, u) ; 
subdelt=delt/10; n=round(delt/subdelt) ; 

A=[0 -1 ; 1 -2 ] ; B= [2 ; 0] ; 

C=[0 1]; delay=0.5; delay_k=round(delay/delt); 
for i=l:n 

dx=A*x+B*u(500-delay_k); 
x=x+dx* subdelt;; 
end 

next_x=x; y=C*x; 
re torn 


command window 

» relay_LD_exl 

w=l. 555, giw=( — 0.565)+i( — 0.188) 


Even though the reference value y ref = 10 is bigger than the process input corresponding to 
the relay magnitude, the two-channel relay feedback method works properly due to the startup 
mode. Also, it rejects the effects of the static disturbance effectively. The identified frequency 
data is close to the real data of G(il.555) = —0.546 —i0.209 and the phase angle arctan 
2(—0.188, —0.565) of the identified frequency model is the same as the prespecified value of 
—7t + arctan(AVA'p). 

12.4.1 Concluding Remarks 

Relay_LO can incorporate a large range of operation using the startup mode. The phase angle 
of the model can be prespecified by adjusting the ratio KJK p . The effects of static disturbances 
can be rejected by updating w ref (f). 

Problems 

12.1 Find all the processes to which the unbiased-relay feedback method can be applied. 

(a) G(s) = 1/(10*+1) 

(b) G(s) = 1/(10* + 1)(j+ 1) 

(c) G(s) = (~5s+l)/(10s+l)(s+l) 

(d) G(s) = exp( - 0.05 j)/(1Qs + l) 

(e) G(s) = 2.0exp(-0.1s)/(3s-l)(s+l). 

12.2 Activate the process G(s) = l/(s + l) 5 using the unbiased-relay and the biased-relay 
feedback methods. Estimate the frequency response using the describing function 
analysis in Chapter 8. 

12.3 Activate the process G(s)= 1 l(s + l) 5 of which the output is corrupted by uniformly 
distributed measurement noise between —0.05 and 0.05 using the unbiased-relay and the 
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biased-relay feedback methods. Estimate the frequency response using the describing 
function analysis in Chapter 8. 

12.4 Activate the process G(s ) = 1 /(s + l) 5 that has a step input disturbance of 0.3 from the 
beginning using the unbiased-relay feedback method combined with static disturbance 
rejection technique in Section 12.2. Estimate the frequency response using the describing 
function analysis in Chapter 8. 

12.5 Activate the process G(s)= M(s + l) 5 at y(t) = 0.5 using the unbiased-relay feedback 
method combined with static disturbance rejection technique in the Section 12.2. 
Estimate the frequency response using the describing function analysis in Chapter 8. 

12.6 Activate the following process of using Relay_ND in Section 12.3 and estimate the 
frequency response using the describing function analysis in Chapter 8. The process has a 
static disturbance. 


d 4 y(0 6 d 2 y(t) 

dt 4 d fi At 2 


d 3 y(0 

W |=o 


d 2 >~(0 _ Ay{t) 

A 2 ( =o d* ;=0 


y(0) = 0, u(t) = 0 for t < 0, 


d(t) = 0.5 for t > 0 


12.7 Activate the following Wiener-type nonlinear process with a step input disturbance using 
Relay-ND in Section 12.3 and estimate the ultimate frequency response of the linear 
dynamic subsystem and the output nonlinear static function: 


w(t) = u(t) + 1.0 


d 4 z(Q d 3 z(t) 

At 4 df 3 




y (t) = 1 — (1 + 2z(f))exp( — 2z(f)) 


12.8 Activate the process in Problem 12.6 at >’ re f = 0.5 using the two-channel relay in 
Section 12.4 to estimate the frequency responses for the phase angles —k/2, — 3ji/ 4, —7t. 

12.9 Activate the virtual process of Process 3 (refer to the Appendix for details) using the 
following relays and estimate the frequency responses. Also, tune the PID controller 
using the ZN or IMC tuning rule and show the control performance. 


(a) Unbiased relay, y ref = 0.0; phase angle, — n. 

(b) Biased relay, y ref = 0.3; phase angle is not specified. 

(c) Unbiased relay combined with disturbance rejection technique, y ref = 0.3; phase 
angle, — n. 

(d) Relay_ND, y ref = 0.3; phase angle, —tc. 

(e) Two-channel relay, y ref = 0.3; phase angle, —3n/4. 


Here, the Fourier analysis or the modified Fourier transform should be used for (b) because the 
oscillation is asymmetric. 
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Modifications of Relay Feedback 
Methods 


13.1 Process Activation Method Using Pulse Signals 1 

This section introduces a closed-loop process activation method to reduce the harmonics and 
obtain more accurate frequency-response data of the process. It can also successfully remove 
the effect of the input nonlinearity by using the disturbance rejection technique. The method 
combines 10 pulses to generate one period of the relay signal. The 10 pulses are combined in an 
optimal way by solving a constrained nonlinear optimization problem to minimize the 
harmonics. In the implementation, the closed-loop process activation method uses the optimal 
solution obtained without continuing to solve the optimization problem any more. So, the 
implementation of the proposed method is almost as simple as that of the previous methods. Let 
us call it Relay_PS. 

The signal generated by Relay_PS (Je et al., 2009) has five pulses in the half-period, as 
shown in Figure 13.1. The first cycle is activated by the conventional relay feedback method. 
First, the relay output (equivalently, process input) u{t) = ad is entered until the process output 
y(t ) deviates from the initial value. After that, one cycle is determined as follows: u(t) = —ad 
when y(t) > 0 and u(t) = ad when y( t) < 0. Here, d is the magnitude of the multi-pulse signal 
and a < 1 is introduced for a smooth transit from the conventional relay mode to the multi-pulse 
mode without changing the fundamental frequency term, which will be explained later. The 
multi-pulse signal of Relay_PS begins to enter after one cycle of the conventional relay signal, 
as shown in Figure 13.1. The process input of the /cth cycle in the multi-pulse mode is 
determined as follows. 

When y(t)<0, the following rules are applied, as shown in Figure 13.1: 

u(t) = d, 0<t-t o .vfc<x(l)/W-i (13.1) 

u(t) = 0, x(l)P onA _i < t-t oa , k <x(2)P ontk _ l (13.2) 


1 Enhanced process activation method to remove harmonics and input nonlinearity, Je et al. Journal of Process Control 
Copyright ©[2008] Elsevier, Inc. 
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«(/) = 0, (1 - x(4))f\„a , < / - / 1>M < (1 - *(3))P 0 ,U i (13.6) 

«(0=<*, (l-x(3))P 0 n,k-i<t-t 0 n,k<(l-x(2))P ont k- l (13.7) 

«(*) = <>, (l-^))^.! < t- W<(l-*(l))Pon^-l (13-8) 

«(0 = 4 (l-x(l))P 0 nA-l <1-W (13-9) 

When y(t) > 0, the following rules are applied, as shown in Figure 13.1: 

u{t) = - d, 0 < t-t ott , k <x{l)P 0 s,k-i (13.10) 

u(t) = 0, *(l)Poff,tt-i < t-t oS ,k<x(2)P ofi , k _ l (13.11) 

u(t)=-d , x{2)P 0 ^ k _ l <t-to«, k <x{Z)Poi i ,k-x (13.12) 

u(t) = 0, x(3)P 0 ff,tfc-i < t-toa,k<x(*)Po«,k-i (13.13) 

u(t)=-d, x(4 )P 0 a^-i<t-t oa ^<(l-x(4))P aB j c . 1 (13.14) 

u(t) = 0, (1 -*(4))f\, fa , < / - Uu < (1 - x(3))P 0 | T .a i (13.15) 

u(t) = -d, (l-x(3))F 0 ffA-i < t-?offA<(l-x(2))F offA _ 1 (13.16) 

u{t)= 0, (1 — x(2))/ > offj *_ 1 < ? — t offj *< (1 — x(l))F 0 ff i A r _ i (13.17) 

u(t)=-d, (l-x(l ))P oH ,k-i<t-t oi{ , k (13.18) 


where P on ,k-i and P 0 ft,k-i denote the time-length of the half-cycle corresponding to the on 
status and the off status respectively of the (k — l)-th cycle in Relay _PS. t on j- and r of f^ represent 
the starting time of the on status and the off status in the /cth cycle respectively. This procedure is 
repeated until the time-length of the cycles converges. 

The x values in (13.1)—(13.18) are determined in an optimal way by solving the constrained 
nonlinear optimization problem (13.19)—(13.21) to minimize the harmonics. As in (13.19), 11 
frequency terms are considered. Frequency terms higher than the 11th term will be negligible 
because the process dynamics dissipate their effects. If one wants to consider more frequency 
terms, then one can just replace 11 by a larger value, but it has no special meanings for the usual 
processes. 


min 



(13.19) 
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subject to 


2 r" 2 f f ^ 3 )" 

b n =-\ u(f)sm(nf) At = - sin(«t) df+ sin(nf) df 

It Jo n [Jo Jx(2)n 

( k-x(4)k ('it 42)* ( n 

+ sin(nf) df + sin ( nt ) df + sin ( nt ) df 

Jx(4)jc Jji-x(3)ji Jn-x{l)n 

(13.20) 


x(l)>0.05, x(2)-x(l) >0.05, x(3)-x(2) >0.05, x(4) - x(3) > 0.05, x(4)<0.5 

(13.21) 


where u(t) is defined as the combination of the 10 pulse signals, as shown in Figure 13.1, and 
d= 1 is assumed without loss of generality. The process input of the cyclic steady state can be 
represented by the Fourier series «(f) = J2n= t b„sm(nt) assuming that the period is 2k 
without loss of generality. The cosine series are not considered because u(t) is an odd 
function. 

The inequality constraints of (13.21) are needed to incorporate practical problems of the 
actuator. If the width of the pulse signal is chosen as too small a value with the intention to 
reduce the harmonics sufficiently, then the actuator cannot realize the abrupt change of the 
signal. For example, the width of the pulse can be constrained to be larger than 5% of the half¬ 
period. The setting is just an example. If the dynamics of the actuator are faster, then a smaller 
value than 0.05 can be chosen, and vice versa. 

The optimal solutions of x(l) = 0.0500, x(2) = 0.1454, x(3) = 0.2114 and x(4) = 0.2614 are 
obtained by the fmincon function in the optimization toolbox of MATLAB. The MATLAB 
code for the optimization is shown in Table 13.1. 

The fundamental frequency term of the optimal solution is b\ = 1.0232 d. Table 13.2 shows 
the harmonics of Relay_PS and the conventional relay feedback method. Relay_PS shows 
significantly smaller harmonics. It should also be noted that the frequent switching during one 
period does not produce any big high-frequency harmonics, as shown in Table 13.2, because 
they are included in the optimization step. The harmonics of an extremely high frequency can 
be negligible because the process dynamics exponentially reduce the magnitude. The 
simulation study in the next section will demonstrate that there are no problems related to 
the frequent switching. 

Because the fundamental frequency term of the conventional relay is 4c//jt and that of 
Relay_PS is 1,0232c/, it is clear that the value of a in Figure 13.1 should be 1,0232jt/4 for the 
smooth transit from the conventional relay feedback mode to the multi-pulse mode of 
Relay_PS without changing the fundamental frequency term. 

It is possible to increase the number of pulse signals to reduce the harmonic terms further. 
Also, the number of the pulse signals can be reduced or the inequality constraints of(13.21)can 
be changed to lighten the load of the actuator due to the frequent switching. But this study 
confines its approach to this point, since this kind of extension is straightforward. 

It should be noted that the above-mentioned optimization problem is not solved further in 
the implementation. The optimal solution obtained of x(l) = 0.0500, x(2) = 0.1454, x(3) = 
0.2114 and x(4) = 0.2614 is directly used in the implementation step. Therefore, the 
implementation steps from (13.1) to (13.18) are quite simple and can be programmed in a 
very cheap microprocessor. 
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Table 13.1 MATLAB code to solve the nonlinear optimization problem of (13.19)—(13.21). 

optim.m 

options = optimset (' Display',' iter',' TolFun', le-10,' TolX', le-10) ; 
[x fval]=fmincon(@objective, [0.06 0.14 0.21 0.3], [], [], [], [], [], [], 
@mycon,options); 
for i=l: 11 

h(i)-harmonics(i,x); 

end 

fprintf ('x(l)=%5.4f,x(2)=%5.4f,x(3)=%S:,4f,x(4)=%|,'3f\n' ,x(l) , 
x(2) ,x(3) ,x(4) ) 

fptkU&ii' b=%5.4f, %5.4f, %5.4£ r *§ . 4f, %5.4f,*5.4$j$5..4f, %5.4f„ 
%5.4f,%5.4f\n',h) 


mycon.m 

objective.m 

function [c,ceq] = mycon(x) 

function [V]=objective(x) 

c(l) = —x (1) + 0.05; 

fqt:i=l: 11 

c(2) = -x (2) + x(l) + 0.05; 

h=harmonics(i,x); 

c (3) - -x (3) + x(2); *0.05; 

coefpgifi-) =h; 

c (4) = -x (4) + x (3) + 0.05;: 

end 

C(5) = x(4) - 0.5; 

s=0.0; 

ceq= []; 

for i=2 :11 

re turn 

s=s+(coeff(i)/coeff(1)) A 2; 


end 


V=s; 


command window 

»optim 

x(l)=0.0500,x(2)=0.1454,x(3)=0.2114,x(4)=0.2614 

b=l.0232, 0.0000, -0.0263, 0.0000, 0.0134, 0.0000, 0.0857, 0.0000, - 
0.0323,-0.0000, 0.0023 


harmonics.m 

function [h]=harmonics(n,x) 
syms (n*t) ; 

g= (2/pi) * (int t' , 0, x (1) *pi) -FiSgi; (f ,•' t' , x (2) *pi, x (3) *pi) tint (f, 

X (4) *pi, (1-x (4)) *pi)+liit (f*'t' , (1-x (3))*pi, ( 1—x (2))*pi)t', 
(1-x(1))*pi,pi)); 
h=double(g); 


The following equations can be derived by neglecting the harmonic terms to estimate the 
ultimate information of the process from the relay feedback test using describing function 
analysis: 


(13.22) 


k ca 


h 

a 


(13.23) 


where a and P are the peak value of the process output and the period in the cyclic steady state 
respectively. co u and k cu respectively represent the ultimate frequency and the ultimate gain 
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Table 13.2 Harmonics of Relay_PS and the conventional relay feedback method. Enhanced process 
activation method to remove harmonics and input nonlinearity, Je et al. Journal of Process Control 
Copyright ©[2008] Elsevier, Inc. 


Relay_PS (b t = 1.0232<f) Conventional method (b t = 4d/n) 


b 2 /d= 0.0000 

by/bi ■ 0.0000 

b 2 /d= 0.0000 

b 2 /b\ — 0.0000 

b 3 /d= -0.0263 

b 3 /bi = -0.0257 

b 3 Jd= 471/3 

b 3 lbi = 0.3333 

bdd= 0.0000 

b A tbi = 0.0000 

bjd= 0.0000 

Mh = 0.0000 

b 5 /d= 0.0134 

M>1 = 0.0131 

b 5 ld =471/5 

M>i = 0.2000 

b(Jd= 0.0000 

Mb = 0.0000 

bfjd —0.0000 

bfjb, = 0.0000 

b 7 ld= 0.0857 

by/bi = 0.0838 

b-jld = 4ji/7 

Mb = 0.1429 

b s /d= 0.0000 

b 8 /b 1 = 0.0000 

bg/d= 0.0000 

b s /b 1 = 0.0000 

b 9 /d= 0.0323 

bg/bi =0.0316 

b 9 /d =47l/9 

M>i = o.iin 

b 10 /d= 0.0000 

Z> 10 /6i = o.oooo 

b 10 /d= 0.0000 

b\(Jb\ — 0.0000 

b n ld= 0.0023 

b\\lb\ — 0.0022 

b n ld= 4jc/11 

b n lbi = 0.0909 

byjd= 0.0000 

b x2 lb x = 0.0000 

b 12 /d= 0.0000 

b\ 2 lb\ = 0.0000 


obtained from Relay_PS test. This describing analysis method is one example to estimate the 
frequency-response data set from the process data activated by Relay_PS. If Relay_PS is 
combined with the disturbance rejection techniques and/or other efficient algorithms, such as 
Fourier analysis and the modified Fourier transform, it is possible to estimate more accurate 
frequency-response data sets and to obtain many more frequency-response data sets. 

The application of Relay_PS to nonlinear system identification will be exemplified in the 
subsequent two sections. 

13.1.1 Comparisons with Previous Approaches 

There are the four previous approaches developed to reduce harmonics. They use a multistep 
signal, saturation-relay signal, sinusoidal signal or preload relay signal (Lee et al., 1995; 
Sung et al., 1995; Shen et al., 1996; Tan et al., 2006). Meanwhile, Relay_PS uses pulse 
signals. This is a remarkable advantage of Relay_PS, because it can reject the effects of the 
input nonlinearity. For example, consider the Hammerstein process of Figure 13.2. If 
Relay_PS is applied in combination with the previous strategies to reject static disturbances, 
then the intermediate signal v(t) becomes a symmetric binary signal for which a unit 
magnitude can be assumed without loss of generality. Then, it is straightforward to obtain the 
ultimate data of the linear dynamic subsystem. Refer to Sung and Lee 2006 and Park 
et al. 2006 for detailed descriptions, which use a similar principle to identify Hammerstein, 
Wiener or Hammerstein-Wiener processes. A simple system identification example is given 
in the next section. 



Figure 13.2 Hammerstein-type nonlinear process. Enhanced process activation method to remove 
harmonics and input nonlinearity, Je et al. Journal of Process Control Copyright ©[2008] Elsevier, Inc. 
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13.1.2 Case Study 

Two kinds of simulations were performed. One compares Relay_PS with the conventional 
relay feedback method. The other demonstrates how the proposed method can be applied to 
identify the Hammerstein process. 

Example 13.1 

Several processes are simulated to demonstrate the performances of Relay_PS and the 
conventional relay feedback method. Tables 13.3-13.5 compares Relay_PS with the conven¬ 
tional relay feedback method for the nth order processes of G p (s) = txp(—0s)/(s + 1)", 
n = 1,2,3. Table 13.6 shows the estimation results for the minimum-phase-zero process of 
G p (s) = (l + 0.3.s) e.xp(—0s)/(s + l) 2 and the nonminimum-phase-zero process of G p (s) = 
(1 — 0.3s) exp(—0s)/(s + l) 2 . Table 13.7 indicates the simulation results for the underdamped 
processes of G p (s) = exp(—0.1s)/(s 2 + 2 gs + 1), £ = 0.3,0.5,0.7. For all the cases, Relay_PS 
provides better estimates than the conventional relay feedback method because it removes the 
harmonics effectively. 


Table 13.3 Simulation results for G p (,s) = e Us Ks + 1). 


0 


k cu 



-u 



Proposed 

Conventional 

Process 

Proposed 

Conventional 

Process 

0.1 

15.0308 

13.3722 

16.3505 

16.3244 

16.4481 

16.2000 

0.5 

3.6160 

3.2338 

3.8069 

3.6787 

3.7760 

3.6733 

1.0 

2.1667 

2.0134 

2.2617 

2.0249 

2.1085 

2.0288 

5.0 

1.0724 

1.2818 

1.1321 

0.5265 

0.5521 

0.5307 

Table 13.4 Simulation results for G p (,s) = 

e "7(.v + l) 2 . 




0 


k cu 






Proposed 

Conventional 

Process 

Proposed 

Conventional 

Process 

0.1 

20.5552 

18.8890 

20.6710 

4.4373 

4.2056 

4.4351 

0.5 

4.6923 

4.4239 

4.6879 

1.9203 

1.8982 

1.9204 

1.0 

2.7057 

2.5522 

2.7069 

1.3046 

1.3156 

1.3065 

5.0 

1.1611 

1.2980 

1.2087 

0.4588 

0.4710 

0.4569 

Table 13.5 Simulation results for G p (,v) = 

e °%f + l) 3 . 




0 


Kn 






Proposed 

Conventional 

Process 

Proposed 

Conventional 

Process 

0.1 

6.1941 

6.0025 

6.2164 

1.5392 

1.5191 

1.5430 

0.5 

3.5422 

3.4286 

3.5436 

1.1544 

1.1428 

1.1508 

1.0 

2.4944 

2.4146 

2.4951 

0.9156 

0.9189 

0.9163 

5.0 

1.2446 

1.1356 

1.2494 

0.3982 

0.4099 

0.4000 
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Table 13.6 Simulation results for G p (s) = 

(1 + oa)e- 

"°' 3s /0 + 1 ) 2 - 



a 


k cu 



0>u 



Proposed 

Conventional 

Process 

Proposed 

Conventional 

Process 

-0.3 

1.7779 

1.7357 

1.7792 

3.6761 

3.3854 

3.6750 

0.3 

4.5399 

4.4248 

4.5716 

12.0737 

10.5146 

12.9023 

Table 13.7 Simulation results for G p (.y) = 

e o u /(/ + 2|.v + 1). 





k ca 



l»U 



Proposed 

Conventional 

Process 

Proposed 

Conventional 

Process 

0.3 

5.8628 

5.2845 

6.0692 

2.5857 

2.4448 

2.6196 

0.5 

9.8006 

8.8919 

10.1796 

3.2057 

3.0354 

3.2623 

0.7 

13.8366 

12.4866 

14.3399 

3.7069 

3.5102 

3.7848 


Table 13.8 shows the MATLAB code to simulate Tables 13.3-13.5. 
Table 13.8 MATLAB code to simulate Tables 13.3-13.5. 


relay_?S_ex". .m 

clear; delt=0.001; tf=30; n=round(tf/delt); 

x=zeros (3,1); %table 13.5 

%x=zeros(2,1); %tablel3.4 

%x=zeros(1,1); %table 13.3 

u_data=zeros(1,1001); 

t_on=0.Off t^_of f=0.0; P_on=0; P_off=0; 

ymin=0.Q; ymax=0.0; np=0; y=0.0; 

index=0,0; y_delta=0.2; 

for i=l: n 

t=i*delt; yy(l)=y; tt ; 

;|f(index==0) u=0.8036;if(y>y_delta) index=l; end; end 
• ft f (index==l) 

If(yy(i)>0.0 & yy(i-l'J<=0.0 ) 

P_on*#~t_on; t_off=t; 
ymax_f=ymax; yxax-C.0; end 
|§8(yy(i)<=0.0 & yy(i-1)>0.0) 

P_Off^t^t^off; t_on=t; np=np+l; 
ymin_f=ymin; ymin=0.0; end; 

if(np<=l &index==l) 

if (y>0,0) u=-0.8036; end 
,.||(y<=0.0) u=0.8036; end; end 
(np>l) 

_>|(y<0.0) 

if(y<ymin) ymin=y; end; 
if(t-t_on<0.05*P_on) u=l; 

elseif(t-t_on<0»1454*P_on) u=0; 
elseif(t-t_on<0.2114*P_on) u=l; 
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Table 13.8 ( Continued ) 

elseif(t-t_on<0.2614*P_on) u=0; 
elseif(t-t_on<0.7386*P_on) u=l; 
elseif( t-t_on<0.7886*P_on) u=0; 
elseif(t-t_on<0.8546*P_on) u=l; 
elseif(t-t_on<0.95*P_on) „-0; 
elseif (0.95*P_on<t-t_on) 

end 

If (y>-0.0) 

Ipf (y>ymax) ymax=y; end; 
;#(t-t_off<0.05*P_off) u=-l; 

elseif (t-t_off<®»1454*P_off) u=0; 
elseif(t-t_off<0.2114*P_off) u=-l; 
elseif(t-t_off<0.2614*P_off) u=0; 
elseif (t-t_off<f:0.7386*P_off) u=-l; 
elseif (t-t_off»50.7886*P_off) u=0; 
elseif(t-t_off<0.8546*P_off) u=-l; 
elseif(t-t_off<0.95*P_off) u=0; 
elseif(0.95*P_off<t-t_off) u=-l; 

end 

end 

end 

for j=l: 1000 u_data (j ) ^d_da a (j + 1) ; end 
»u (i) =iV? u_data (1001) =u; 

[x,y]=process_pwml(x,delt,u_data); 
end 

P=P_on+Pi^j@j^|‘va= (ymax_f-ymin_f) /2; w_u=2*pi/P 
AR_u=a/l.0232; k_cu=l/AR_u; 
fprintf( ' kcu=%5.3f, wu=%5.3f\n',k_cu,w_u); 
figure (1) ; plot (tt, uu, tt, yy) ; 


g_relay_PS_exl.m 

functtiSli [next_x, y] =g_relay_PS_exl (x, delt, u) ; 
subdelt=delt/10; n=round(delt/subdelt) ; 

%table 13.3 

%A=-1; B=11 C=1; delay=0.1; 

%table 13.4 

%A= [0 -1; 1 -2] ; B= [ 1; 0] ; C= [0 1 ] ; delay=0.1; 

%table 13.5 

A= [ 0 0.-1; 1 0 -3; 0 1 -3] ; 

B= [1; 0; 0 ]; C* [001]; delay=0.1; 
delay_k=round(delay/delt); 
for i=l: n 

dx=A*x+B*u(1000-delay_k); 
x=x+dx* subdelt; 

end 

next_x=x; y=C*x; 


command window 

» relay_PS_exl 
kcu=6.189, wu=l.542 
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Example 13.2 

The following Hammerstein process is simulated to demonstrate the additional advantage of 
Relay_PS compared with the previous approaches developed to reduce harmonics. 

v(t) = 1 — exp(— 0.3u(t)) (13.24) 


y(s) exp(— 0.5^) 

H*) - (j+i ) 2 


(13.25) 


Equation (13.24) is the input nonlinearity and (13.25) is the linear dynamic subsystem. The 
intermediate signal v(t) is not measurable. 
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(a) 



Figure 13.3 Estimation performances of the proposed method for the Hammerstein process: activated 
process signals (a) and (b); equivalent Hammerstein process (c); modeling result for the input nonlinearity 
(d). Enhanced process activation method to remove harmonics and input nonlinearity, Je et al. Journal of 
Process Control Copyright © [2008] Elsevier, Inc. 
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(c) 



(d) 

Figure 13.3 ( Continued ) 


Figure 13.3 shows the activated process signals by Relay_PS combined with the disturbance 
rejection method (Park et al., 1997). The MATLAB code to simulate Figure 13.3a and b is 
shown in Table 13.9. The upper value of the process input has been updated by the following 
equation, as shown in Figure 13.3a: 



where a max ,jt —i and a min ^_i are the (k — l)-th peak value and the (k — l)-th valley value of the 
process output. is the Ath upper value of the process input. The update rule (13.26) is just 
an example. A tuning parameter can be included to compromise between the convergence rate 
and the robustness. For detailed descriptions on the update rule, refer to Chapter 12. 

Note that the update (13.26) results in a symmetric v(t) signal, as shown in Figure 13.3b. 
Then, it can be assumed that the upper value and the lower value of v(t) are + 1 and — 1 
respectively, without loss of generality, because there is one degree of freedom to adjust (3, as 
shown in Figure 13.3c. Then, the ultimate data (<w u = 1.921 (actual: 1.920) and A: u = 5.828 
(actual: 4.686)) of the dynamic subsystem G(s ) is obtained from the cyclic-steady-state input 
and output data in Figure 13.3a. Also, the model v(f) = 0.876 u(t) — 0.124 u(t) 2 from 0 = (3/(0), 
1 =/3/(1.433) and —1 =/3/(—1.000) is obtained. Here, v{t) corresponds to (3v(t). Figure 13.3d 
compares the model v(t)/(3 = (0.876w(/)) — 0.124w(/j 2 j//3 obtained and the actual input 
nonlinear function of v(t) = 1 — exp(— 03u(t)). Here, (3 = 2.863 is used, estimated by l/v max . 
It confirms that Relay_PS can successfully identify the Hammerstein process. The previous 
approaches cannot be applied to this kind of application. 
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Table 13.10 shows the MATLAB code to estimate the nonlinear model from the process 
input and output activated by Relay_PS. It should be executed after the code of Table 13.9 is 
executed because it uses the data obtained by the code of Table 13.9. 

13.1.3 Concluding Remarks 

A new closed-loop process activation method was introduced to provide more accurate 
ultimate data estimates by reducing the harmonics as well as the effect of the input nonlinearity. 
It minimizes the harmonics by combining the ten pulse signals in an optimal way by solving 
the constrained nonlinear optimization problem. The implementation is quite simple, so 
that a very cheap microprocessor is enough to realize the proposed algorithm. Simulation 
examples demonstrate that Relay_PS can remove the harmonics and the input nonlinearity 
simultaneously. 

Table 13.9 MATLAB code to simulate Figure 13.3a and b. 

relay_PS_ex2 .m 

clear; delt=0.002; tf=30; x=[0;0]; n=round(tf/delt) ; u_data=zeros 

( 1 , 1001 ); 

v-C.C; y-0.0; t_on=0.0; tubf £ =0.0; P_on=0; 

.0; ymax=0.0; np=0; umax=l. 0 ; UlfiiiJ™-! . 0; ±ndex=0.0; y_delta=0.1; 
fo*'i*=l: n 


if(index==Q) u=0.8036; if(y>y_delta) index=l; end; end 
|ytr|l.ndex==l) 

if(yy|£^ >0.0 & yy (i-1)<=0.0 ) 

P_on=t-t_on; t„_of; i — ; y{tiin_f=yinin; ymax=0.0; 
if(v>0) vmax=v; else vmin=v; end 

if (yy(i)<=0.0 & yy ( 1 - 1 ) >0.0 ) 

P_off ~’f i *f_of f; ymin=0.0 ; np=np+l; ymax_f=ymax; 

jif (v>0) vmax=v; e 1 se wnir.-v; end 
iff||np>=2) 

umax=umax-2.0*((ymax_f+ymin_f)/(abs(ymax_f)+abs(ymin_f))) ; 

end 

end 

^^P(np<=l & index==l) 

if(y>0.0) u=-0.8036; else u=0.8036; end; 

if(y<0.0) 

if(y < ymin) ymin=y; end 
else 

if(y>ymax) ymax=y; end 
end 

if(np>l) 
if(y<0.0) 

if(y<ymin) ymin=y; end 
if(t-t_on<0.05*P_on) u=umax; 
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(b) 

Figure 13.4 Schematic diagram of Relay_SS (a) and typical responses (b). Enhanced Frequency 
Response Estimator to Guarantee Pre-specified Phase Angle and Static Disturbance Rejection with All 
Harmonics Removed, Sung and Lee, Korean Journal of Chemical Engineering Copyright ©[2008] 
Korean Institute of Chemical Engineers. 
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13.2 Process Activation Method Using Sine Signals 2 

This section introduces the process activation method using sine signals to remove the 
harmonics of the process input completely, to guarantee the specified phase angle and to 
reject the effects of disturbances (Sung and Lee, 2008). Also, the stability conditions of the 
process activation method are discussed. Let us call it Relay_SS. 

Figure 13.4 shows the schematic diagram and the typical response of Relay_SS. 

Relay_SS uses one cycle of the conventional relay feedback signal followed by a sinusoidal 
signal combined with a pulse signal. The role of the pulse signal is to enforce the process output 
and the process input to converge to the complete sinusoidal signal. In Figure 13.4b, the first 
several cycles of the incomplete sinusoidal signals converge to the complete sinusoidal signal 
by the guidance of the pulse signals. Then, the important conclusion reached is that the process 
input and the process output in the cyclic steady state include no harmonics. The reference w ref 
for the process input is automatically updated to enforce the oscillation of the process input and 
output to be symmetric by rejecting the effects of the static disturbance. In Figure 13.4b, the 
reference value for the process output in the relay feedback method is y ref =0.5, which is 
equivalent to introducing a static disturbance. Nevertheless, Relay_SS automatically raises the 
process output up to the reference value of y ref =0.5 and provides the symmetric oscillation of 
the complete sinusoidal signal by updating w ref . 

Consider the following steps to understand the working of the process activation method in 
more detail. Step 1, obtain one cycle from t = 0 to t « 10 using the conventional relay feedback 
method. That is, u(t) = d when y(t) < y ref , u{t) = —d when y(t) > y le f , where d, u{t), y(t ) and y ref 
denote the magnitude of the relay, the process input, the process output and the reference value 
of the relay feedback respectively. The role of Step 1 is to initialize the initial parameters of 
the sinusoidal mode. Step 2, change from the relay feedback mode to the sinusoidal mode. In 
the sinusoidal mode, Relay_SS determines the process input as follows. 

When y(t) > y ref (negative input status): 

4d 

u(t) = - ^sin[cof_ ,(f- toB *) -</>] +Mref if f < (13.27) 

u(t) - - sin« T ,PoffM 1 - <f>) + w ref if r“P ected < t < t“ pected + 8 (13.28) 

u{t) = - ^sin ^ +u Kf if t>C n pected + 5 (13.29) 

u(t) = - ^sin[wf f /off .a) -<t>\ - +w re f if t < t®ff ected -S (13.30) 


2 Enhanced Frequency Response Estimator to Guarantee Pre-specified Phase Angle and Static Disturbance Rejection 
with All Harmonics Removed, Sung and Lee, Korean Journal of Chemical Engineering Copyright ©[2008] Korean 
Institute of Chemical Engineers. 
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When y(t)<y re f (positive input status): 

M (t)=^sin[<_ 1 (t-W)-^]+Wref ift<cr d (13.31) 

u(t) = ^sin (vZLiPont-t-fl + ite if f“ pected <t < t“ pected + S (13.32) 

u(jt) = ^sinlw^iPon^-i -<f>)+ ^ +Wref if t > xted + 5 (13.33) 

4d 4d 

u(t) = — sin[o»^_ 1 (r— t on> jt) -|pjh — +Mref if t < ?“P ected - 8 (13.34) 

where o>f_ l = n/P oS , k - u < n _ , = n/P OD , k - u /^P ected = t 0ff , k + P 0 ff,k-i and t“ pected = 
t 0 n.k + Pon,k - i • P 0 s,k -1 and P 0 a,k -1 denote the time-length of the half-cycle in the previous 
(k— l)-th cycle corresponding to the negative input status and the positive input status 
respectively. t onk is defined as the time at which the process input changes from the negative 
input status to the positive input status, which is the start of the on status of the A'th cycle. 
The negative input status of the Mi cycle starts at t 0 s,k- ;®*P ected = t 0 nk + Pon.k -1 and 
^expected _ P on k _ , are the expected subsequent t on and t off on the basis of the previous 

half-periods of P 0 ff,k-i and P (m ,k -1 ■ ~ K + $ corresponds to the prespecified phase angle 
between the process input and the process output. 8 in (13.29), (13.30), (13.33) or (13.34) is a 
small positive value to prevent undesirable activation due to uncertainties. Because the 
magnitude of the fundamental frequency term of the relay mode is 4d/n, we choose the 
magnitude of the sinusoidal signal of 4 din for the smoothing transit from the conventional relay 
mode to the sinusoidal mode without changing the magnitude of the fundamental frequency 
term. 

Let us explain the role of each equation from (13.27) to (13.34). If the process reaches a 
cyclic steady state (that is, P 0 «,k -i = P 0 ft,k and P (m ,k -1 = P nn ,k), then only (13.27) and (13.31) 
will be activated. It is clear that u(t ) of (13.27) or (13.31) has no harmonics and the phase angle 
between u{t) and y(t) is exactly — n + cj) in the cyclic steady state. Then, it is straightforward to 
estimate the exact frequency model, of which the phase angle is exactly — n + <j>. 

When the continuous cycling of the process input/output deviates from the desired cyclic 
steady state, Relay_SS forces the continuous cycling to go back to the desired position by 
adding the additional step signals of 4dln to the sinusoidal signals, as shown in (13.29), (13.30) 
and (13.33), (13.34). For simplicity, assume 5 = 0 and consider the mechanisms shown in 
Figure 13.5. 

If y(t) > y re f an d t > ^P ected (that is, the process output has not crossed the reference value 
yet, although it is expected to cross at t = t“ pected ), then the time-length corresponding to the 
positive status of the process output should be shortened. This can be achieved by simply 
adding a negative additional signal of —4 din (which corresponds to the negative pulse in 
Figure 13.5a) to the process input, as shown in (13.29) and Figure 13.5a. Also, the time-length 
of the negative status of the process output can be shortened by adding the positive additional 
signal of 4d/n (which corresponds to the positive pulse in Figure 13.5b) to the process input, 
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Figure 13.5 Mechanisms to achieve a cyclic steady-state. Enhanced Frequency Response Estimator to 
Guarantee Pre-specified Phase Angle and Static Disturbance Rejection with All Harmonics Removed, 
Sung and Lee, Korean Journal of Chemical Engineering Copyright ©[2008] Korean Institute of Chemical 
Engineers. 


as shown in (13.33) and Figure 13.5b. This is the same principle as used in the conventional 
relay feedback method, which shortens the time-length of the positive status of the process 
output cycle by entering a negative process input, and vice versa. 

If y(t)<y ref and t < ?“P ected (that is, the process output crosses the reference value earlier 
than expected), then the time-length corresponding to the positive status of the process output 
will be lengthened by adding a positive additional signal of 4 din (which corresponds to the 
positive pulse in Figure 13.5c) to the process input, as shown in (13.34) and Figure 13.5c. The 
same mechanism is applied to the opposite case, as shown in Figure 13.5d. 

Equations (13.28) and (13.32) of the proposed method are to prevent undesirable activation 
of (13.29), (13.30) and (13.33), (13.34) due to cycle-to-cycle uncertainties, such as measure¬ 
ment noise and high-frequency disturbances. 8 will be a small positive value. If the overload of 
the actuator is of no concern, then (13.28) and (13.32) can be removed. 

M ref is updated in each cycle by u ref (k ) = u re fk — 1) + a(2d/K')(P on (k — 1) — P 0 ff(k — 1))/ 
P{k — 1), which shifts w re f as much as the magnitude of the zero-frequency quantity to reject 
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the effects of the disturbance and to obtain a symmetric input signal. Here, P OB (k — 1) and 
P„fiik — 1) are the time-lengths corresponding to the positive status and the negative status 
of the process input signal respectively. P(k — 1) = P on (k — 1) + P„n(k — 1) corresponds to 
the time-length of the (k— l)-th cycle and (2d/n)(P on (k — 1) — P off (k— 1 ))/P(k — 1) is the 
time-average value (equivalently, the zero-frequency quantity) of the previous cycle. Note 
that (2d/Ti)(P on (k — 1) — P„n{k — 1 ))/P(k — 1) monotonically decreases as the process input 
u ie f + D increases, where D is the input static disturbance. So, the update u re f(k) — u ief 
(k— l) = a(2d/n)(P on (k — 1) — P 0 ff(k— l))/P(k— 1) will remove the effect of the static 
input disturbance (equivalently, making u le f + D = 0), resulting in symmetric responses 
of the process input and output. The convergence of the update method will be discussed in 
the next section. 

In this research, it is recommended that a = 1.5 exp[—(« c — l)/r„]. Here, n c is the number of 
the sinusoidal cycles. x a determines the convergence rate of u ref . A small x a means a fast 
convergence, but too small a x a will not provide enough time for u ref to converge to the right 
value. Therefore, 3 < x a < 5 is recommended. Roughly speaking, this requires four to six 
cycles to obtain symmetric process input and output. A typical performance is shown in 
Figure 13.4b with x a = 3. Here, the reference value of the process output is 0.5. It confirms 
Relay_SS provides the symmetric cycle for the nonzero reference value. Previous relay 
feedback approaches cannot provide the symmetric cycle for the nonzero reference value if 
they have no mechanism to reject static disturbances. 

From the activated process data by Relay_SS, the frequency data can be estimated in a 
straightforward manner. Because the process output in the cyclic steady state is y(t) = 
a sin(tof) + y ref for the process input u(t) = 4d sin [cor — (—jt + (j))]/n + w ref , the identified 
frequency data of the process is 

\G(iu>)\=™ r ZG(ico) = -n + c/> (13.35) 

where a is the measured oscillation magnitude of the process output. 

Relay_SS removes the effects of static disturbances and provides the oscillation correspond¬ 
ing to the prespecified phase angle. Also, it can remove harmonics completely, resulting in 
exact frequency-response estimates of (13.35). 

13.2.1 Discussions on Convergence 

There are insurmountable limitations in proving the convergence in a rigorous way for all 
the possible situations in operating Relay_SS. So, discussion of the convergence of 
Relay_SS will be confined to the two restricted situations of Case 1 and Case 2 with several 
assumptions. 

Case 1 Assume that there is no entry of static disturbances (no update of u ref ) and that a small 
perturbation is added to the amplitude or frequency of the signal during the cyclic-steady-state 
operation. The necessary condition (Loeb condition) for a stable limit cycle in Case 1 is 
(Atherton, 1975) 

kdUdQ 0V0P\| 

V0w 0a 0w0a/| m=(i)c 


>0 


(13.36) 
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where G(ico) = U((o) + iV(w) and — MN(a) = P(a) + i Q(a). a> c is the frequency of the cycle. 
N(a ) is the describing function of Relay_SS. It is clear that N(a) = ( 4d/na ) exp(—ir/j) because it 
generates the output u(t) = (4d/n) sin(W — <r/>) for the input —y(t) = a sin(«/) and the effects of 
the additional signals are negligible for such a small perturbation. Then, P(a ) = —(na/4d) cos 
(</>) and Q{a) = —{na!4d) sin(<r/j). Then, (13.36) becomes 

/ _ 0[/7tsin(^) 0Vjtcos(^)\| 

V 0a> 4d 0« 4d ) ^ 1 ’ 

We know that cos(<£) and sin(</>) are always positive because 0 <4>< Jt/2. Note that most 
processes for 0 <4>< 7t/2 (equivalently, —Jt/2 < /G(iw) < —7t) are one of the two cases dU/ 
® w L=g) c — 0,0W0w| M=mc > 0 and Of//0w| m _ Mc > 0,0 W0<w| M=a>c > 0 because the imaginary part 
V of most processes increases as w increases. It is clear that the first case of 0///0&)| (i)=a) < 0 
and 0V70«| ffl=fflc >0 satisfies (13.37). 

Equation (13.37) can be rewritten for the second case of 0t//0<w| a , ==ft} >0 and 0V7 
0V/0ft)l , 

a " w< wmz:. (13J8) 

Consider Figure 13.6. Here, tan(^) = (0V / /0w| M==a) J/(0f//0w| ffl=a) J and tan(^>) = U(w c )/ 
V(w c ). Most processes satisfy 4><(p for a small <r/j, and equivalently (13.38). Now, it is proven 
that the proposed test signal generator in Case 1 provides a stable limit cycle for most processes. 

Case 2 Assume the situation that a static disturbance enters during the cyclic-steady-state 
operation and that u ret is updated. The update method can be expressed as in Figure 13.7. 



Figure 13.6 <p > </> for most processes. Enhanced Frequency Response Estimator to Guarantee Pre¬ 
specified Phase Angle and Static Disturbance Rejection with All Harmonics Removed, Sung and Lee, 
Korean Journal of Chemical Engineering Copyright ©[2008] Korean Institute of Chemical Engineers. 
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(a) 



Figure 13.7 w ref update method (a) and a typical step response (b). Enhanced Frequency Response 
Estimator to Guarantee Pre-specified Phase Angle and Static Disturbance Rejection with All Harmonics 
Removed, Sung and Lee, Korean Journal of Chemical Engineering Copyright ©[2008] Korean Institute 
of Chemical Engineers. 


D denotes the static input disturbance. The zero-frequency quantity of the process input 
Z a (k—l) = (2d/n)(P on (k—l) — P of f(k—l))/P(k—l) can be measured from the previous 
cycle. Then, the discrete-time overall process can be defined, of which input and output are 
u re fjt) (or u re fk) + D ) and Z u (k) respectively, as shown in Figure 13.7 a. Here, assume that the 
perturbation by the static disturbance is so small that the internal feedback loop inside the 
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overall process is internally stable as in Casel. Now, note that Z u (k) is proportional to 
—(w ref (fc) + D ) around u re f{k) + D = 0 because the symmetricalness of the signal continu¬ 
ously degrades as u ie f(k ) + D is increased. For example, Figure 13.7b shows a typical step 
response of Z u {k) for the positive step input of u Ki {k) + D. As expected, it shows a linearity 
between Z u (k) and u ref (k) + D. Now, it can be inferred that the update method would be more 
stable as the gain a is decreased. 

Let us derive a rough range of a to stabilize the update system. Note that the step response in 
Figure 13.7b reaches the steady-state within almost one cycle. This is coincident with the fact 
that relay feedback methods can usually obtain a cyclic-steady-state within such a small 
number of cycles (2-3 cycles). Then, Z u (k ) is approximately a function of u ief (k— 1) + D. 
Then, a qualitative condition for convergence can be derived as discussed below with the 
assumption that the approximation is valid. 

Zy = k p (D + w ref + Z u ) is valid at the steady state, where Zy and k p are the zero-frequency 
quantity of the process output and the static gain of the process respectively. Assume k p > 0 
without loss of generality. Then, Z a = Z y lk p — D — u ref is obtained. Flere, Z LI and Z y are negative 
and positive respectively for a positive!) + u iet because u ief + D decreases the zero-frequency 
quantity of the process input while it increases that of the process output. Then, \Z u {k + 1)1 is 
smaller than \u ref (k) + !>l, as shown in Figure 13.7b. So, the discrete-time overall process has 
the following transfer function: 

Z u (z) = (13.39) 


where u K r(k) = u rC f(k) + D and u K f(z) is the r-transform of u rc f(k). (3 is positive and less than 
unity. The update method with a positive a has the following transfer function: 


_az l Zj$ 
I- — 1 


Mref(O) 

1-z- 1 


(13.40) 


Then, the following closed-loop transfer function is obtained from (13.39) and (13.40): 


Z u (z) = 


- jb’»,ef(Q) 

1 - z~ 1 +z~ 2 aj8 


(13.41) 


It is straightforward to derive the condition of 0 < a < \//3 for a stable update from (13.41). 
This means that a = 1 will stabilize the closed-loop response because /3 is less than unity. 


Example 13.3 

The following process is simulated to confirm the performance of Relay_SS: 


G(s) = 


(zs+ l)exp(- 0.3y) 


(13.42) 


Table 13.11 shows the estimated amplitude ratio and frequency corresponding to the 
prespecified phase angle. As expected, the proposed method with z a = 3 provides almost 
exact estimates for the range — it/2 < ZG(iw) < —n. If a bigger x a is chosen and there are no 
numerical errors, then Relay_SS would provide exact estimates. Table 13.12 shows the 
MATLAB code for Example 13.3. 
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Table 13.11 Estimated frequency responses for the SOPTD process of G p (s) = (zs + l)exp(—0.3s)/ 
(s + l) 2 . Enhanced Frequency Response Estimator to Guarantee Pre-specified Phase Angle and Static 
Disturbance Rejection with All Harmonics Removed, Sung and Lee, Korean Journal of Chemical 
Engineering Copyright © [2008] Korean Institute of Chemical Engineer. 



Process (z 

= 0.2) 

Relay_SS 
(z = 0.2) 

Process 

(z=-0.2) 

Relay_SS 
(z = —0.2) 

IG(iw)l 


IG(ko)l 

0, 

IG(iw)l 


IG(iw)l 


-n 

0.079 

3.884 

0.079 

3.876 

0.225 

1.940 

0.226 

1.936 

-3n/4 

0.240 

1.849 

0.242 

1.859 

0.419 

1.207 

0.420 

1.205 

—n/2 

0.555 

0.911 

0.558 

0.908 

0.678 

0.700 

0.679 

0.700 


Table 13.12 MATLAB code to simulate Table 13.11. 

relay_SS_exl.m 

clear;-^£=30.0; delt=0.01; phase=pi/4; 
u=zeros(1,1000) / relayl=0.0; x=zeros(2,1) ; 

tf_k=round (tf/delt) ; rand (' seed' , Q) ; noise=2* (rand (1, tf_k) - 0.5) ; 
yref=0y2:; dn=0; dis=0.0; d=1.0; 

%phase angle=-pi+phase, dead_zone=dn*delt, relay magnitude=d, di's= 
disturbance 

alpha=3.0; nmag=0.0; hys=2*nmag+0.01; %uref updata rate, noise magnitude, 
hysteresis 

index_up=l; index_down^lj-.,index_u_update=l; %no uref update-0,uref 
update-1 

y=0.0; yb=0.0; t_on=0.0 iffe 6f C-'O'. 0; Pon=0.0; Po£f-Pon; 
amax=0; arftiii=Q; number=-4; t_on_add=0.0; t_off_add=0.0; 

%£sf_add=0; on_add=0; sul.w.0.0; uref=0.0; y_deX1»a=0.1; 

for k=l: tf_k 

t=(k-1)*delt;T(k)=t;Y(k)=y;U(k)=(relayl+index_u_update*uref); 

Uref =uref; Yref (k) =yref; far i=l:999 =u (i+1) ; end 
if(number>-4 & y-yref>=hys) index_up=l; end; 
y^f(number>-4 & y-yref<=-hys) index_down=l; end 
if((y-yref<=y_delta) & (number==-4)) 

re 1ayl-d; if (y-yref>=y_delta-hys) index_up=l; number=-3; end 
end 

^f((y-yref>0.0) & (number==-3) & (index_down==l)) 

relayl=-d; number=-2; t_ofips3i; index_down=0; index_up=0; 

end 

if((y-yref<=0,0) & (number==-2) & (index_up==l)) 

relayl=d;number=-l; t_on=t;index_down=0;index_up=0; 

end 

if.( (y-y re: >C . 0) & (number==-l) & (index_down==l) ) 

relayl=-d; number=0; t_of^|pi; PQ.n=t-t_onindex=0; index_down= 1 ; 
V^ndex_up=0 ; 

if(number>=-l) 
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Table 13.12 ( Continued ) 
sul=sul+relayl*delfi; 

if ( (y-yref)>=0.0 & (yb-yref)<0.0 & (index_down==l)) 
t_off_expect=t_on+Pon; 

lyi ( L_o£ : ;_expec-_-L>0.0) _add-t._of f_oxpect-t; else t_off_add=0; 

end 

f=t; index**©? index_down=0; index_up=0; 

end 

if ((y-yref)<=0.0 & (yb-yref)>0.0 & (index_up==l)) 
index_down=0; index_up=§f 

t_on_expect=t_off+Po|f; if (t_on_expecg*$>0.0) t_on_add=t_on_ 
expecg-^g; else t_on_add=0; end 

t_oPoff=t-t_Q:®t'i : , i ®idex=l; number=number+l; 
amax_s=amax; amin_s=amin; amax-S.fi; aminf^O; P=Pon+Poff;su=sul; 
if (number?**©) 

w=2*pi/P; kdr-'i,«b* (exp (- (number-1) /3) ) *su/P; 

(kd<l. 5*d) iifcef=uref+kd; else uffei=uref+1.5*d; end 

end 

sul=0.0; 
end 

if(amax<(y-yref)) amax=y-yref; end; if(amin>(y-yref)) amin=y-yref; 
end 

j|f (number>=l) 
lit ( i r.dex—0) 
w-pi./Pbff; 

if(t-t_off<t_off_add-dn*delt) off_add=-4*d*l/pi; else 
off_add=0.0; end 

relayl=4*d*sin (w* (t-t_off) -pi-phase) /pi+iSij£_add; 

-jLf(Pof f< (t-t^jfeff) & Ppf£+dn*delt>= (t—t_of f) & (y-yref) >0.0) 
relayl=4*d*sin(w*Poff-pi-phase)/pi; 
end 

if(Poff+dn*delt<(t-t_off) & (y-yref)>0.0) 

relayl=4*d*sin(w*(t-t_off)-pi-phase)/pi-4*d/pi; 

end 

end 

f (index==l) 
w=pi/Pon; 

if(t-t_on<t_on_add-dn*delfc) on_add=4*d*l/pi; else on_add=0.0; 

end 

relayl=-4*d*sin(w*(t-t_on)-pi-phase)/pi+on_add; 

•i) (?on< (t.-t._cr.) & Pon+dn*delt>-(t-t_on) & (y-yref) <0.0) 
relayl=-4*d*sin(w*Pon-pi-phase)/pi|'. ' 
end 

if(Pon+dn*delt<(t-t_on) & (y-yref)<0.0) 

relayl=-4*d*sin(w*(t-t_on)-pi-phase)/pi+4*d/pi; 
end 
end 
end 
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Table 13.12 ( Continued ) 

' f ( L>—0) dis=0.0; end 

u (1000)=relayi+index_u_update*uref+dis; yb=y; 

[x,y]=g_relay_SS_exl(x,delt,u); y=y+nmag*noise(1,k); 
end 

figure (3) ; plot(T,U, ' g' ,T,Y, 'b' ,T,Yref,' k' ,T,Ure: , ' r' ) ; 

Period=P; w=2*pi/P; s=j*w; PA=(-pi+phase)*180/pi; 

Model_AR=(amax_s-amin_s) 121 (4*d/pi); Model_w=w; 

[w ar]=ar_angle(phase); 

%Process_PA=(-pi+phase)*l8Q/pi 
Process_AR=ar; Process_w=w; 

AR_error=l00*(Process_AR-Model_AR)/Process_AR; 
w_erreaN=100*(Process_w-Model_w)/Process_w; 

fprintf('Model: w=%5.3f AR=%5.3f PA=%5.4f\n',Model_w,Model_AR,PA); 
fprintf ('Process: w=%5.3f AR=%$,3f PA^|Sl, 4f\n',Process_w,Process_AR, 
PA) ; 


g_relay_SS_exl.m 

ar_angle .tn 

fund i on 

fjinction 

[next_x, y] =g_relay_SS_exl (x, delt, tij ;‘ 

[w ar ]=ar_angle(phase) 

subdelt=delt/10.0; 

w=0.0; del=0.01; 

n=round(delt/subdelt) ; 

for i=l: 100000 

A=[0 -1; 1 -2]; B=[1; 0.2]; 

w-w-de 1; s=j *w; 

C=[0 1] ; delay=0.3; 

[G]=process (s); 

delay_k=round(delay/delt); 

PA=angle(G); 

for i=l: n 

if(imag(G)>0.0) 

dx=A*x+B*u(1000-delay_k); 

PA=-pi-2*pi+angle(G); 

x=x+dx*subdelt; 

end 

end 

if(PA<(-pi+phase)) 

next_x=x; y=C*x; 

break; 

return 

end 



command window 

a=w-del; b=w+del; 

» relay_SS_exl 

fop; |el: 1000: 

Model: w=l.848 AR=0.232 PA=-135.0000 

c=(a+b)/2; 

Process: w=l.859 AR=0.239 PA=-135.0000 

s=j*a; [G]=process(s); 
PAa=angle(G)+pi-phase; 
s=j*c; [G]=process(s); 
PAc=angle(G)+pi-phase; 
if(PAa*?Ac<0.0) c-c; 
else a=c; end 
^f^abs(PAa)<0.0000001) 
break; end 

end 


ar=abs (G) ; w=c; 


return 

function [G]=process (s) 
G=exp(-0.3*s)*(0.2*s+l)/ 
(s-1) A 2; 


return 
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Table 13.13 Comparisons of Relay_SS with previous methods in estimating the ultimate data 
corresponding to ZG(itu) = —it. Enhanced Frequency Response Estimator to Guarantee Pre-specified 
Phase Angle and Static Disturbance Rejection with All Harmonics Removed, Sung and Lee, Korean 
Journal of Chemical Engineering Copyright ©[2008] Korean Institute of Chemical Engineers. 



Process 

Conventional 

Modified 

Relay _SS 

IG(i<u)l 


IG(iw)l 

0, 

IG(ioj)l 

03 

IG(i&))l 

03 

61 = 0.1 

0.061 

16.32 

0.075 

16.36 

0.066 

16.32 

0.061 

16.31 

61 = 0.2 

0.118 

8.444 

0.143 

8.537 

0.125 

8.468 

0.118 

8.440 

61=1.0 

0.442 

2.029 

0.486 

2.107 

0.437 

2.040 

0.444 

2.024 

61 = 3.0 

0.774 

0.819 

0.746 

0.856 

0.792 

0.821 

0.776 

0.818 


Example 13.4 

The following process is simulated to compare Relay_SS with the previous methods of the 
conventional relay feedback method and Sung et al. (1995): 

GW = t^=if) (13.43) 

Equation (13.43) is chosen because it usually shows bigger modeling errors than other high- 
order processes for the harmonics included in the process input. Table 13.13 shows the 
estimated amplitude ratio and frequency corresponding to ZG(itu) = —n. As expected, the 
proposed method provides the best estimates in most cases. 

13.2.2 Concluding Remarks 

Using Relay_SS to solve the harmonics problem of the previous approaches completely is 
introduced. It can remove all the harmonics by using the sinusoidal signal directly, of which the 
frequency is automatically updated to guarantee the desired phase angle. Relay_SS also rejects 
the effects of static disturbances by adjusting the reference value of the sinusoidal signal. 

Problems 

13.1 Activate the process G(s ) = 1/(5 + l) 5 using Relay_PS in Section 13.1 and estimate the 
frequency response using the describing function analysis in Chapter 8. 

13.2 Activate the virtual process of Process 3 (refer to the Appendix for details) using 
Relay_PS in Section 13.1 and estimate the frequency response using the describing 
function analysis in Chapter 8. Tune the PID controller using the ZN tuning rule and 
demonstrate the control performance. 

13.3 Activate the following Hammerstein nonlinear process using Relay_PS combined with 
the disturbance rejection technique in Section 13.1 and estimate the ultimate frequency of 
the linear dynamic subsystem and the input nonlinear function. Compare the model 
output and the process output. 
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v(t) = 1 - exp( - 0.3 u(t)) + 0.2 u(t) 


d 3 y(0 ? d 2 y{t) 

d/ 3 d f~ 


13.4 Activate the process of G(s ) = 1/(5 + l) 5 using Relay_SS in Section 13.2 with y ref = 0.3 
and estimate the frequency response for phase angles of —n, —3n/4, —n/2 using the 
describing function analysis in Chapter 8. 

13.5 Activate the virtual process of Process 3 (refer to the Appendix for details) using 
Relay_SS in Section 13.2 with y ref =0.3 and phase angle of —n and estimate the 
frequency response using the describing function analysis in Chapter 8. Tune the PID 
controller using the ZN tuning rule and demonstrate the control performance. 
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Appendix 

Use of Virtual Control System 


A virtual control system composed of a user’s MATLAB codes and virtual processes is used to 
emulate real situations in industry. This can contribute significantly to improving the ability to 
solve real problems in industry. Students can practice the whole procedure of process 
activation, modeling, controller design and implementation on the basis of a virtual control 
system. This appendix introduces the virtual control system and several examples of user 
codes. 

A.l Setup of the Virtual Control System 

The overview, installation and setting the parameters of the virtual control system are briefly 
explained in this section. 

A. 1.1 Overview 

The virtual control system is composed of a buffer, a user’s code and a virtual process. 
Figure A.l shows a schematic diagram for data exchange between the user’s code and the 
virtual process. 



period: sampling time period: scan time 
Figure A.l Schemetic diagram of the virtual control system. 
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The virtual process is coded using Visual Basic and the user’s code is a MATLAB m-file. The 
buffer is one of several forms of database. Excel, clipboard and data file, of which the role is 
temporal data storage to incorporate the data exchange between the user’s code and the virtual 
process. The user’s code periodically sends the control output u{t) to the buffer and gets the time 
t and the process output y(t) from the buffer with the period of the sampling time. The virtual 
process periodically sends t and y( t) to the buffer and gets u{ t) from the buffer with the period of 
the scan time. The sampling time should be larger than the scan time. Also, it is recommended 
to choose the sampling time as a multiple of the scan time. 


A. 1.2 Installation 

Installation of the virtual control system is very simple. Just double click on Setup.exe in the 
package directory and input the directory name into which all the files are extracted. Let us call 
the directory “virtual system directory.” To run the virtual control system, click on the Windows 
start menu and choose the virtual control system or double click on Virtual Processes.exe in the 
virtual system directory. MATLAB functions (get_t, get_y and set_u) for the data exchange 
between the user’s code and the virtual process are provided in the virtual system directory so 
that the user can exchange their data with the virtual processes easily without knowing the 
details of the system. The present working directory of MATLAB should be the virtual system 
directory. Also, the user’s code should be placed in the virtual system directory. If the user wants 
to use another directory, then they should make sure that all the files in the virtual system 
directory are placed in the directory and double click on the Virtual Processes.exe to run the 
virtual processes (do not use the Windows start menu in this case). 


A. 1.3 Setting the Virtual Processes 

Figure A.2 shows the virtual processes. The user can choose one of the available virtual 
processes from the menu in Figure A.2a. Figure A.2b shows the chosen virtual process. If the 
user clicks on the button again, the virtual process will be reset and restarted. 

The user can set the parameters of the virtual process, such as the upper limit and lower limit 
of the process input, the scan time and scaling of the axes by inputting a numeric value to the 
text box and clicking on the Press to Set button. 


A.2 Examples 

Several examples of user codes are introduced to demonstrate how to use the virtual control 
system. 


A.2.1 Process Activation Using a Step Signal 

Table A.l shows the user’s MATLAB code to activate a virtual process using a step signal 
u(t ) = 3 for 20 < t and u(t) I for t < 20. Figure A.3 shows the dynamic behavior of the virtual 
control system for the step input test. The process output measured by the user’s code in 
Table A.l and the process input set by the user’s code are shown in Figure A.4. 
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Virtual Control System HI 
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Table A.l User’s MATLAB code to activate a virtual process using a step signal. 

my_step_test.m 

f unction [data_t data_y data_u] =my_step_test (tf) 
sampling_time = 0.5; % samp ling time 
[ t] =get_t () if %time reading 

n_tf=round(tf/sampling_time); t_ref=t; i=0; 
while t<=tf 

[t]=get_t() ; % Time reading 
delt=t-t_ref; 

'jLf (delt>=sampling_ti®ef 0.99) 
t_ref=t; 

% Beginning of my control algorithm 
[y] =get_y () ; %process output reading 

if(20.0<=t) u=3.0; else u=l,0f. end % controller output 
set_u (u) ; % Control output senflfjg 
% End of my control algorithm 

data_t(i)=t; data_u(i)=u; data_y(i)=y; % data storage 
end 
end 

figure (1) ; plot(data_t,data_y) ; 
figure (2) ; plot (data_t, data_u) ; 


command widow 

» [data_t data_y data_u] =my_step_test (100) ; 




I Process and Control Output 
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Set Scaling of Axes 
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Figure A.3 Response of the virtual process for the step input test. 
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Table A.2 ( Continued ) 

% Begj^pjiag of my corflilsdl algorithm 
[y]=get_y() ; %process output reading 
if(20.0<=t) ys=3.0; else ys=2.0; end % setpoint 
s=s+kc*(ys-y)*delt/ti; 

'■•iu-kc* (ys-y) +s+kc*£#?( (ys-y) - (ysb-yb) ) /delt; %control output 
ysb=ys; yb=y; 

set_u(u) ; % Control output sending 
% End of my control algorithm 

data_t(i)=t; data_u (i) NgijS data_y (i) =y; % data storage 
end 
end 

figure (1) ; plot (data_t, data_y) ; 
figure (2) ; plot (data_t, data_u) ; 


command widow 

» [data_t data_y data_u] =my_pid (130) ; 



Figure A.5 Response of the virtual process for the PID controller. 
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Figure A.6 The process output and the process input obtained by the user’s MATLAB code in Table A.2. 


A.2.2 Process Control Using a Proportional-Integral-Derivative Controller 

Table A.2 shows the user’s MATLAB code to control a virtual process using a PID controller for 
which the parameters are k c = 1.2, t; = 10.0 and r d = 6.0 and the setpoint is 3.0 for 20 < t. 
Figure A.5 shows the response of the virtual processes for the PID controller. The process 
output measured by the user’s code in Table A.2 and the process input set by the user’s code are 
shown in Figure A.6. 

A.2.3 Process Activation Using the Relay Feedback Method 

Table A.3 shows the user’s MATLAB code to activate a virtual process using the relay feedback 
method with u(t) = 3 for y(t) < 2.0 and u(t) = 0 for y(t) > 2.0. The relay feedback starts at 
20.0 < t. Figure A.7 shows the response of the virtual processes for the relay feedback method. 
The process output measured by the user’s code in Table A.3 and the process input set by the 
user’s code are shown in Figure A.8. 
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Table A.3 User’s MATLAB code to activate a virtual process using the relay feedback method. 

function [data_t data_y data_u] =my_relay (tf) 
sampling_time = 0 
[t]=get_t() ; %Time reading 

n_||pround (tf /samplinrg_t;ime) ; ; 

while t<=tf 

[t]=get_t() ; % Time reading 
delt=t-t_ref; 

•J 1 (delt>=sampling_tit|@*0.99) 

; t_ref=t; 

% Beginning of my control algorithm 
[y] =get_y () ; %process output reading 
if (t>20.0) 

' (3.0<=y) u=0.0; else u=3.0; end % relay 

else 

u-1.C; 

set_u(u) ; % Control output sending 
% End of my control algorithm 

data_t(i)=t; data_u(i)=u; data_y(i)=y; % data storage 
end 
end 

figure (1) ; plot (data_t, data_y) ; 
figure (2) ; plot (data_t, data_u) ; 


command widow 

» [data_t data_y data_u] =my_relay (150) ; 
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Figure A.7 Response of the virtual process for the relay feedback method. 
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